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1.  INTRODUCTION. 


The  Federal  Aviation  Administration  (FAA)  has  developed  a  Terminal  Doppler  Weather 
Radar  (TDWR)  to  detect  wind  shear  and  other  kinds  of  hazardous  weather  in  the 
airport  terminal  area  and  to  provide  warnings  to  air  traffic  controllers  and 
pilots . 

A  major  goal  of  the  TDWR  program  is  to  provide  automatic  detection  and  warning  of 
microbursts ,  the  most  hazardous  form  of  wind  shear  for  aircraft  approaching  or 
departing  from  airports.  In  addition  to  microburst  detection,  information  on  gust 
fronts,  wind  shifts,  and  precipitation  will  be  available.  These  products  will  be 
displayed  in  real  time  so  that  air  traffic  controllers  can  transmit  alerts  to 
pilots . 

The  FAA  awarded  a  contract  for  production  of  47  TDWR  systems  in  the  fall  of  1988, 
to  Raytheon  Company,  Sudbury,  MA. 

1.1  SCOPE. 

This  document  provides  the  overall  philosophy  and  approach  to  the  TDWR  Operational 
Test  and  Evaluation  (OT&E)  Integration  portion  of  Technical  Field  Test  and 
Evaluation  (TFT&E)  to  be  conducted  at  the  FAA  Aeronautical  Center  (FAAAC)  in 
Oklahoma  City,  OK.  This  plan  identifies  the  necessary  support  (e.g.,  personnel, 
documentation,  etc.)  that  is  required  to  accomplish  OT&E  Integration.  Test  roles 
and  responsibilities  of  personnel,  training  requirements,  and  schedule  of 
activities  are  also  included.  This  plan  identifies  the  National  Airspace  System 
(NAS)  operational  and  integration  requirements  of  the  TDWR.  These  requirements  are 
contained  in  the  Test  Verification  Requirements  Traceability  Matrix  (TVRTM)  of 
appendix  A. 

1.2  PURPOSE. 

The  overall  purpose  of  this  plan  is  to  ensure  the  successful  OT&E  Integration  prior 
to  fielding  the  TDWR  in  the  NAS.  To  meet  this  objective,  the  TDWR  must  be 
operationally  integrated  with  both  new  and/or  existing  systems  (to  be  defined  in 
section  5.).  The  Installed  TDWR  must  be  tested  in  order  to  verify  that  it  is 
functioning  as  specified  in  the  NAS -SS- 1000.  It  is  this  "end- state"  configuration 
that  this  plan  addresses,  and  it  also  discusses  the  methods  of  testing  which  must 
be  conducted  to  ensure  that  the  TDWR  meets  the  NAS  operational  and  integration 
requirements . 

1.3  AUTHORITY  TO  CHANGE. 

The  authority  to  change  the  plan  herein  outlined  is  vested  in  the  Test  Director, 

FAA  Technical  Center,  ACW-200. 
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This  section  lists  the  documentation  and  reference  materials  which  relate  to  the 
contents  of  this  plan. 


2.1  FAA  DOCUMENTS 


2.1.1 

FAA  Specifications 

FAA-E-2806a 

Terminal  Doppler  Weather  Radar 

Specification 

FAA-E-2570b 

Automatic  Radar  Tracking  System 
(ARTS)  Requirement 

NAS -SS- 1000 

NAS  System  Specification 

Volumes  I  and  III 

NAS -SR- 1000 

NAS  System  Requirements 

Specification 

NAS-IR-22013105 

Interface  Requirements  for  Tower  Control 
Computer  Complex  (TCCC)  to  Terminal  Doppler 
Weather  Radar  (TDWR)  (TCCC/TDWR) 

NAS-IC-31055103-00 

Interface  Control  Document  for  TDWR  (RMS)/ 
Maintenance  Processor  Subsystem  (MPS) 

NAS-IC-31055104-00 

Interface  Control  Document  for  TDWR/ 
Maintenance  Data  Terminal  (MDT) 

NAS-IC-31052201-00 

Interface  Control  Document  for  TDWR/Tower 
Control  Computer  Complex  (TCCC) 

2.1.2 

FAA  Standards 

FAA- STD -024a 

Preparation  of  Test  and  Evaluation 
Documentation 

2.1.3 

FAA  Orders 

No.  1810. 4B 

FAA  NAS  Test  and  Evaluation  Policy 

No.  1812.9 

System  Requirements  Statement  for  the 
Terminal  Doppler  Weather  Radar 

No.  6560.26 

Project  Implementation  Plan  (PIP)  for 
the  TDWR 

No.  1810. 2A 

Independent  OT&E 
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2.1.4 


Other  FAA  Documents 


Transportable  Radar  Analysis  Computer 
System  (TRACS)  User's  Manual 


2.2  MILITARY  AND  FEDERAL  PUBLICATIONS 


2.2.1  Military  Standards 
MIL-STD-1472C 


Hxjunan  Factors  Standard 


2.2.2  Federal  Documents 
DOD-STD-2167 


Defense  System  Software  Development 


2.3  OTHER  DOCUMENTS 

TDWR  MTP 

NAS -MD- 110 

NAS -MD- 790 

NAS -MD- 792 

NAS-MD-793 

ASM- 630 
CDRL  #  DOOl-2 
CDRL  #  D002-3 


Terminal  Doppler  Weather  Radar 
Master  Test  Plan 

Test  and  Evaluation  (T&E)  Terms 
and  Definitions  for  the  NAS 

Remote  Maintenance  Monitoring 
System  (RMMS)  Interface  Control 
Document 

Operational  Requirements  for 
the  Remote  Maintenance 
Monitoring  System  (RMMS) 

RMMS  Functional  Requirements  for 
the  Remote  Monitoring  Subsystem  (RMS) 

TDWR  Shakedown  Test  Plan 

TDWR  Contractor's  Master  Test  Plan  (CMTP) 

Design  Test  and  Evaluation  (DT&E)  Test  Plan 


CDRL  #  D004-3 


Installation  Checkout  and  Acceptance  (IC&A) 
Test  Plan 


CDRL  #  D007-3 


Turnkey  Installation  Test  Plan 
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3.  TDWR  OT&E  INTEGRATION  TEST  PLAN  OVERVIEW. 


This  section  contains  background  Information  required  to  substantiate  that  the 
system  requirements  delineated  in  FAA  Order  1812.9  are  being  met  and  also  to 
facilitate  an  understanding  of  the  testing  activities  performed  at  the  test  site. 

3.1  TDWR  OT&E  INTEGRATION  TEST  PLAN  PHILOSOPHY. 

The  TDWR  OT&E  Integration  Test  Plan  will  provide  assurance  in  the  verification  of 
the  applicable  requirements  identified  in  the  TVRTM,  as  discussed  in  section  4  of 
this  plan.  FAA  Order  1810. 4B  directs  the  verification  of  all  system/subsystem 
requirements,  and  states  that  these  requirements  will  be  verified  as  early  as 
possible  in  the  procurement  process.  The  FAA  Program  Engineering  Service  (ANR) 
has  responsibility  for  developing  and  implementing  the  verification  process  for 
requirements  of  each  project.  The  FAA  Technical  Center  will  support  ANR  throughout 
the  verification  process.  The  TDWR  Program  Office,  ANR-500,  may  delegate 
verification  activities  to  other  FAA  organizations,  independent  contractors,  and/or 
the  prime  project  contractor,  Raytheon  Company. 

With  this  philosophy  implemented,  ACW-200  will  ensure  that  the  following  OT&E 
Integration  related  activities  are  accomplished: 

a.  Develop  an  OT&E  Integration  Test  Plan,  including  a  TVRTM,  which  contains  a 
reference  to  each  of  the  NAS  operational  and  integration  requirements. 

b.  Develop  detailed  OT&E  Integration  Test  Procedures  and  appropriate 
simulation  scenario  scripts  necessary  for  each  of  the  tests  defined  in  the  TDWR 
OT&E  Integration  Test  Plan. 

c.  Assist  ANR'500  in  Installation,  Checkout,  and  Acceptance  (IC&A)  testing 
and  Design  Qualification  Testing  (DQT)  by  reviewing  test  procedures  and  providing 
an  FAA  witness  for  these  tests. 

d.  Conduct  NAS  OT&E  Integration  of  the  TDWR  using  first  production  deliveries 
to  the  test  site  (Oklahoma  City)  and  identify  those  areas  which  were/could  not  be 
verified. 


e.  Verify  and  document  the  completion  of  each  test  with  a  success  criteria 
that  satisfies  the  TVRTM. 

f.  Distribute  questionnaires  to  pilots  and  air  traffic  controllers.  The 
questionnaires  will  be  used  to  assess  the  observations  of  participating  personnel 
regarding  the  functional  and  physical  characteristics  of  the  data  displays  and  the 
acceptability  and  timeliness  of  the  weather  warnings.  An  example  of  the 
questionnaires  to  be  used  for  OT&E  Integration  are  included  in  appendix  B.  These 
questionnaires  are  merely  examples  and  are  not  the  questionnaires  that  will  be  used 
for  OT&E  Integration. 

g.  Track  and  status  problems  encountered  during  OT&E  Integration  using 
service  reports  as  defined  in  section  7.2.3. 
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h.  Provide  test  reports/notification  to  the  ANR-500  on  the  pass/failure  of 
the  TDWR  subsystem  in  the  area  of  OT&E  Integration. 

When  OT&E  Integration  is  complete,  the  following  objectives  will  be  satisfied: 

a.  Ensure  early  detection  of  interface  design  problems. 

b.  Verify  that  the  interface  design  yields  specification  mandated 
performance . 

c.  Verify  the  TDWR's  capability  to  properly  interface  with  available 
(simulated)  equipment  and/or  subsystems  at  the  test  site. 

d.  Minimize  risks  associated  with  proceeding  toward  the  next  project 
milestone . 

e.  Provide  guidance  to  follow-on  TDWR  sites  in  the  area  of  OT&E  Integration. 

f.  Ensure  that  an  operationally  effective  and  suitable  system  is  implemented 
into  the  NAS . 

The  verification  of  all  system- level  requirements  will  determine  the  TDWR 
operational  effectiveness  and  suitability,  and  identify  operational  deficiencies  to 
provide  Information  on  operational  procedures,  organizations,  training,  logistics, 
and  personnel  requirements  prior  to  field  deployment.  It  is  these  system- level 
requirements  which  this  plan  is  structured  to  satisfy. 

3.2  TDWR  OT&E  INTEGRATION  TEST  PLAN  -  APPROACH  AND  CONCEPT. 

In  order  to  determine  the  overall  operability  of  the  TDWR  with  the  NAS  environment, 
OT&E  Integration  requires  that  the  TDWR  be  installed  in  an  operational  environment 
with  operational  support  available,  i.e.,  Air  Traffic  Control  Tower  (ATCT)  and 
Terminal  Radar  Approach  Control  Facility  (TRACON).  An  operational  environment 
relates  to  the  configuration  into  which  the  TDWR  must  be  integrated.  For  this 
reason,  both  live  and/or  simulated  Interfacing  subsystems  and  equipment  will  be 
used.  Air  Traffic  (AT)  and  Airways  Facilities  (AF)  field  site  personnel  will  also 
be  requested  to  participate  in  test  efforts.  These  test  efforts  will  include 
providing  support  in  writing  and  executing  the  detailed  test  procedures  that  will 
be  generated  by  ACW-200  to  verify  the  requirements  identified  for  testing.  The 
TDWR  OT&E  Integration  will  be  performed  using  all  interfaces  available  and 
appropriate  to  the  TDWR  system. 

To  fully  understand  the  approach  and  concepts  of  testing,  the  differences  between 
the  terms  "interim"  and  "end-state,"  and  how  these  terms  relate  to  testing,  must 
first  be  understood.  The  TDWR  is  one  project  of  the  NAS  Plan.  The  NAS  Plan's  goal 
is  the  modernization  and  improvement  of  the  government  systems  supporting  aviation 
commerce  in  the  United  States.  The  time  after  the  plan  has  been  fully  implemented 
is  called  the  "end-state"  of  the  NAS.  The  period  before  all  equipment  of  the  NAS 
has  been  fielded  is  the  "interim"  period.  In  the  interim  period,  the  TDWR  product 
information  will  be  displayed  to  air  traffic  controllers  and  controllers' 
supervisors  on  equipment  supplied  by  the  TDWR  contractor,  Raytheon  Company.  In  the 
end-state  of  the  NAS  Plan,  the  TDWR  will  send  weather  product  information  to  Air 
Traffic  Control  (ATC)  computers  and  the  Tower  Control  Computer  Complex  (TCCC) . 
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In  order  to  save  schedules  and  avoid  unnecessary  duplication  of  activities, 

Raytheon  will  participate  in  efforts  aimed  at  carefully  coordinating  the  contractor 
and  government  testing.  Descriptions  of  Raytheon  test  planning  (at  Raytheon,  as 
well  as  on-site  at  the  test  site)  may  be  found  in  the  Contractor's  Master  Test  Plan 
(CDRL-DOOl-2) ,  sections  3.3.3  and  4.3,  and  DT&E  Test  Plan  (CDRL-D002-3) ,  section 
3.3. 

3.2.1  TDWR  OT&E  Integration  Testing  Baseline. 

Since  the  TDWR  is  an  end- state  system,  the  TDWR  OT&E  Integration  testing 
configuration  is  baselined  in  accordance  with  NAS -SS- 1000.  The  OT&E  Integration 
verification  on  an  end- state  subsystem  must  be  conducted  in  a  well  documented, 
"step-by-step"  process.  One  "step"  at  a  time  means  combining  end-state  with 
interim  configurations,  wherever  possible,  and  documenting  verified  end- state 
requirements,  until  ultimately  achieving  the  end- state  integrated  configuration. 
Each  "step"  completion  will  be  evident  by  the  documented  verification  that  the  TDWR 
functionally  and  physically  interfaced  with  an  end-state  subsystem. 

The  TDWR  OT&E  Integration  test  will  ultimately  consist  of  one  unique  end- state 
configuration.  This  configuration  is  composed  of  the  TDWR  subsystem  interconnected 
with  other  subsystems  as  shown  in  figure  3. 2.1-1.  The  Low  Level  Wind  Shear  Alert 
System  (LLWAS)  interface  is  shown.  However,  this  Interface  is  reserved.  Each 
interconnection  (interface)  within  the  configuration  is  defined  as  a  verification 
category  (CAT).  For  ease  of  identification  and  traceability  to  the  TVRTM,  a  letter 
has  been  assigned  to  each  verification  category.  This  lettering  system  becomes 
clear  in  section  S. 

The  approach  to  TDWR  OT&E  Integration  testing  at  the  test  site  will  first  require 
each  identified  Interface  (verification  category)  to  be  verified  individually, 
followed  by  a  combination  of  the  verification  categories  to  form  the  End-State 
System  Level  Test.  For  interfaces  which  are  not  available  for  testing,  interim 
subsystems  and/or  simulation  tools  will  be  used  to  verify  the  associated 
requirements.  Inputs  used  will  consist  of  live  and/or  simulated  information 
including  message  data,  as  defined  in  the  subsections  of  section  5.  This  will  add 
further  assurance  that  each  test  will  assist  in  the  verification  of  the  assigned 
OT&E  Integration  requirements. 

3.2.2  Verification  Methods. 

Two  types  of  verification  methods  will  be  applied  to  the  verification  categories 
conducted.  The  methods  of  verification  are  defined  as  follows; 

a.  Test  (T)  -  Test  is  a  method  of  verifying  performance  requirements  of 
subsystem/system  or  configuration  items  by  quantitative  measurements  of  controlled 
functional  or  environmental  stimuli.  These  dynamic  measurements  are  made  using 
standardized  laboratory  equipment,  procedures,  or  other  services,  then  analyzed  to 
determine  their  compliance. 

b.  Demonstration  (D)  -  Demonstration  is  a  method  of  verifying  subsystem/ 
system  or  configuration  item  requirements  by  observing  their  functional  response 
to  dynamic  exercising.  This  qualitative  evaluation  is  made  using  criteria  from 
technical  procedures,  excluding  measurements.  Acceptance  is  based  on  pass/fail 
results . 
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3.3  TDWR  OT&E  INTEGRATION  ACTIVITY  FLOW. 

The  sequence  of  TDWR  OT&E  Integration  tests  and  the  associated  pretest  activities 
to  be  conducted  at  the  test  site  are  presented  in  figure  3.3-1. 

Raytheon  will  interface  the  TDWR  radar  to  the  appropriate  radar  processing  and 
display  subsystems  located  at  the  first  test  site,  Oklahoma  City,  OK.  .Raytheon 
shall  then  proceed  with  Installation  Checkout  and  Acceptance  (IC&A)  and  on-site  DQT 
to  validate  that  the  installed  system  satisfies  the  requirements  of  FAA-E- 2806a. 

The  DQT  ends  with  a  72 -hour  continuous  operation  of  the  system  without  hardware  or 
software  failure.  The  Reliability  Demonstration  follows  and  this  will  be  conducted 
24  hours  per  day,  7  days  per  week  until  the  satisfactory  number  of  operating  hours 
have  accumulated.  Raytheon  is  responsible  for  conducting  this  Reliability 
Demonstration.  A  Preliminary  Contractor  Acceptance  Inspection  (PCAI) ,  a  dry  run  of 
the  formal  Contractor  Acceptance  Inspection  (CAI),  will  follow.  At  this  time,  the 
integrated  system  and  all  documentation  will  be  handed  over  to  ANR-500  in 
preparation  for  Technical  Field  Test  and  Evaluation  (TFT&E) . 


4.  TDWR  OT&E  INTEGRATION  VERIFICATION  CONTROL. 


The  following  section  describes  the  method  that  will  be  utilized  to  ensure 
traceability  of  requirements  to  the  verification  categories  and  test  configuration 
discussed  in  section  3  and  defined  in  section  5  of  this  plan. 

4.1  TDWR  TVRTM. 

The  TVRTM  contained  in  appendix  A  identifies  the  TDWR  end- state  requirements  that 
will  be  verified  throughout  TDWR  OT&E  Integration.  This  matrix  was  developed  in 
accordance  with  appendix  IV  of  FAA-STD-024a,  NAS-SS-1000,  and  NAS-SR-1000. 

The  TVRTM  lists  the  applicable  requirements  from  NAS-SS-1000,  Volumes  I  and  III, 
that  require  integration  verification.  Each  of  the  requirements  will  be  verified 
by  the  identified  verification  methods  (denoted  by  a  "D"  for  demonstration,  or  a 
"T"  for  test)  through  the  successful  completion  and  execution  of  TDWR  NAS  OT&E 
Integration  Test  Procedures.  Test  procedures  will  be  developed  for  each 
verification  category  discussed  in  section  3.2  and  as  defined  in  section  5  of  this 
plan.  The  actual  tests  to  be  conducted  will  be  identified  in  the  test. procedures . 
In  most  Instances,  several  of  the  NAS  requirements  listed  in  the  TVRTM  will  be 
satisfied  by  one  single  test  procedure.  Therefore,  the  exact  number  of  test 
procedures  cannot  be  determined  until  they  are  written. 

This  plan,  along  with  the  TVRTM  and  resultant  test  reports  of  TDWR  OT&E 
Integration,  will  be  made  available  to  the  Program  Office  for  use  at  future  TDWR 
sites  to  help  insure  the  timely  completion  of  TDWR  OT&E  Integration. 
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5.  TDWR  OT&E  INTEGRATION  TEST  CONFIGURATION. 


The  TDWR  OT&E  Integration  consists  of  the  configuration  and  related  verification 
categories  discussed  in  section  3.2  of  this  plan.  This  section  will  define  the 
test  configuration  and  its  associated  verification  categories. 

The  requirements  of  the  TVRTM  discussed  in  section  4  have  been  logically  grouped. 
These  groups  are  verification  categories.  Each  category  has  been  developed  to 
identify  a  specific  TDWR  subsystem's  interface  capability  to  function  properly  in 
the  NAS  system.  The  term  interface  is  interchangeable  with  the  term  verification 
category  much  in  the  same  manner  as  the  terms  integration  and  interface  testing  are 
interchangeable  as  defined  by  NAS-SS-1000.  Tlie  tests  will  be  perfoxmied  in  a 
logical  manner.  Tests  that  rely  on  completion  of  other  tests  are  considered 
subordinate  tests  and  will  be  performed  upon  satisfactory  completion  of  primary 
tests.  A  description  of  Che  primary  and  subordinate  tests  will  be  included  in  the 
test  procedures.  Upon  successful  testing  of  all  interfaces,  tests  for  an  end- 
state  system  will  be  performed. 

For  each  verification  category,  the  following  information  will  be  specified:  test 
description,  test  objectives,  evaluation  criteria,  test  configurations,  support 
hardware,  support  software,  special  test  equipment,  data  analysis,  and 
documentation  that  will  be  required  for  its  verification.  This  information  shall 
be  utilized  for  the  development  of  Che  detailed  TDWR  OT&E  Integration  Test 
Procedures.  A  description  of  the  test  configuration,  followed  by  each  of  the 
verification  categories  (which  comprise  the  configuration) ,  is  presented  in  the 
following  subsections.  The  verification  categories,  or  interfaces,  for  the 
configuration  are  as  follows; 

CONFIGURATION  1  -  Terminal 

Category  A  TDWR/TCCC  Interface 

Category  B  TDWR  Remote  Monitoring  System  (RMS) /Maintenance 

Data  Terminal  (MDT) /Maintenance  Processor  Subsystem 
(MPS)  Interface 

Category  C  End-State  System  Level  Test 
5.1  TEST  ACCOMPLISHMENT. 

This  section  presents  the  tests  which  will  be  performed  for  requirements 
verification.  The  OT&E  Integration,  as  contained  in  the  TVRTM,  is  a  repeat  of  that 
previously  accomplished  by  Raytheon  with  the  same  TDWR  system  located  at  the 
factory  site.  The  purpose  of  this  testing  is  to  reverify  the  system  interface  in  a 
different  clutter  environment.  These  tests  may  not  be  as  extensive  as  the  previous 
tests.  The  same  test  sequence  will  be  followed  but  will  not  be  repeated  in  detail 
in  this  section,  except  as  necessary,  to  satisfy  interface  differences  and  concerns 
related  to  the  test  site. 
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Verification  Category  A  will  verify  the  requirements  related  to  the  transmission  of 
products ,  equipment  status ,  TDWR  modes ,  and  receipt  of  commands  from  the  TDWR 
subsystem  to  the  TCCC  located  in  the  ATCT.  It  will  verify  the  data  exchange 
required  from  the  TDWR  in  accordance  with  ICD  NAS-IC-31052201-00,  NAS-SS-1000,  and 
FAA-E- 2806a.  These  tests  will  be  conducted  using  approved  test  procedures. 

Note:  The  TCCC  interface  will  not  be  available  for  0T6eE  Integration  testing 

(June  -  September  1992).  Test  Operators  will  use  appropriate  simulation 
hardware  to  satisfy  test  objectives. 


5. 1.1.1  Test  Oblectives. 

The  objectives  of  Category  A  testing  is  to  verify  that  the  TDWR  has  the  capability 
to  interface  with  the  TCCC  in  accordance  with  the  following  TVRTM  requirements: 

1170,  1171,  1290 

5. 1.1. 2  Evaluation  Criteria. 

The  criteria  for  success  shall  be  the  assurance  that  each  requirement  listed  for 
Category  A  in  the  TVRTM,  and  the  objective  stated  in  section  5. 1.1.1,  has  been 
satisfied.  This  criteria  for  success  for  each  requirement  shall  be  that  the 
weather  data,  products,  and  alert  messages  disseminated  to  the  TCCC  from  the  TDWR 
is  correct. 

5.-1.1.3 _ Test  Configuration. 

Verification  Category  A  test  configuration  is  as  shown  in  figure  5. 1.1. 3-1. 

5. 1.1.4  _ Support  Hardware. 

The  following  support  hardware  will  be  required  for  Category  A  testing: 

a.  TCCC  (or  simulated  TCCC) 

b.  Geographic  Situation  Display  (GSD) 

c.  Ribbon  Display  Terminal  (RDT) 

5.1. 1.5  _ Support  Software. 

The  following  support  software  will  be  required  for  Category  A  testing: 

TBD 


5. 1.1. 6 _ Special  Test  Equipment. 

The  following  special  test  equipment  will  be  required  for  Category  A  testing: 

a.  Archive  Data  Recorder 

b.  Time  Series  Recorder 

c.  Base  Data  Recorder 

d.  Government- Furnished  Equipment  (GFE)  Modems 

e.  Hard  Copy  to  GSD  and  RDT 
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5. 1.1. 7  Data  Analysis. 


Test  data  will  be  gathered  by  designated  test  team  members  from  test  logs,  printer 
outputs,  and  storage  devices  (disk  drives,  tape  drives,  etc).  The  data  will  be 
analyzed  in  detail  to  provide  a  comprehensive  analysis  of  the  TDWR.  Data  will  be 
analyzed  during  test  conduct  to  insure  that  the  tests  are  proceeding  as  predicted. 
In  addition,  all  data  will  be  thoroughly  analyzed  after  the  fact  to  insure  that  all 
discrepancies  are  noted  and  properly  addressed. 

5. 1.1. 8  Documentation. 

The  following  reference  material  will  be  made  available  to  appropriate  personnel 
prior  to  test  conduct. 

TDWR  Master  Test  Plan 
TDWR  OT&E  Integration  Test  Plan 
TDWR  OT&E  Integration  Test  Procedures 
NAS-IC-31052201-00  -  TDWR/TCCC  ICD 
NAS-SS-1000  -  NAS  System  Specification 
FAA-E-2806a  -  TDWR  Specification 

5.1.2  Category  B  •  TDWR  (RMSWRMMS. 

Verification  Category  B  will  verify  that  the  required  interfaces  between  the  TDWR 
and  Remote  Maintenance  Monitoring  System  (RMMS)  are  properly  integrated.  This 
verification  category  includes  the  following: 

a.  TDWR  (RMS)/MPS 

b.  TDWR  (RMS)/MDT 

The  RMMS  will  provide  the  capability  to  monitor  the  performance  of  and  remotely 
adjust  equipment  and  facilities  through  the  use  of  RMSs  embedded  in  the  TDWR.  All 
RMSs  shall  communicate  with  a  centrally  located  data  processor,  the  MPS.  The  MPS 
shall  control  the  communications  flow  to  all  remote  facilities  and  shall  collect, 
record,  and  analyze  the  facility  data.  MDTs  will  be  used  to  enter  commands,  data 
requests  and  messages ,  and  to  display  the  responses  to  those  commands ,  data 
requests,  and  messages. 

5. 1.2.1  Test  Objectives. 

a.  Verify  that  the  TDWR  provides  the  NAS  adequate  data  to  continually  monitor 
subsystem  performance  to  obtain  data  needed  by  specialists  for  maintenance  and 
operations  support  in  accordance  with  the  following  TVRTM  requirement: 

2110 

b.  Verify  that  the  TDWR  provides  the  status  of  subsystems  to  specialists  and 
generates  alarms  upon  deviation  of  designated  parameters  from  prescribed  limits  in 
accordance  with  the  following  TVRTM  requirement: 

2120,  2670 
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c.  Verify  that  Che  TDWR  provides  Che  NAS  sufflclenC  daCa  for  a  specialise  on 
slCe  or  aC  an  off-slCe  locaClon  Co  concrol  selecCed  subsysCems  for  malnCenance 
purposes  In  accordance  wlch  Che  following  TVRTM  requlremenC: 

2130,  2650,  2660 

d.  Verify  ChaC  Che  TDWR  provides  Che  NAS  sufflclenC  daCa  Co  allow  Che 
specialise  Che  capablllcy  Co  Idenclfy  Che  line  replaceable  unlc  (LRU)  causing  an 
equlpmenC  failure  In  accordance  wlch  Che  following  TVRTM  requlremenC: 

2140 

e.  Verify  Chac  Che  TDWR  provides  Che  NAS  sufflclenC  daCa  Co  allow  Che 
specialise  access  Co  monlCorlng,  concrol,  and  daCa  managemenC  capablllCles  of  Che 
NAS  as  required  and  as  auchorlzed  by  admlnlscraClve  dlrecclve  In  accordance  wlch 
Che  following  TVRTM  requlremenC: 

2150 

f.  Verify  chac  Che  TDWR  provides  Che  NAS  adequace  daCa  Co  allow  conclnuous 
monlCorlng  of  scacus,  Including  conflguraClon  and  mode,  alarms  sec  and  resec,  and 
performance  of  selecCed  subsysCems.  The  TDWR  will  also  auComaClcally  provide  Che 
accumulaCed  sCaCus  and  performance  daCa.  IC  will  also  provide  reporcs  chaC  concaln 
only  scaCe  changes  and  alarms/alercs  In  response  Co  a  subsysCem  scacus  reporC  or 
RMMS  access  requesc  by  a  specialise  chrough  an  MDT,  In  accordance  wlch  Che 
following  TVRTM  requlremenCs : 

2210,  2310,  2320,  2330,  2331,  2340,  2341, 

2350,  2360,  2390,  2550,  2610,  2620 

g.  Verify  chac  Che  TDWR  provides  for  Che  NAS  an  alarm  when  smoke,  fire,  or 
physical  InCruslon  occurs  In  a  subsysCem  faclllCy.  An  alarm  will  also  be  provided 
when  Che  elecCrlcal  power  or  HeaClng,  VenCllaClon,  and  Air  CondlClonlng  (HVAC) 
monlcored  parameCers  are  ouc  of  Colerance  aC  unmanned  faclllcles.  Concrol  of  HVAC 
and  elecCrlcal  power  In  unmanned  faclllcles  will  also  be  verified.  When  Che  above 
condlclons  are  cleared,  alarms  will  be  reseC  In  accordance  wlch  Che  following  TVRTM 
requlremenCs : 


2370,  2371,  2372,  2380,  2381,  2470,  2480, 

2520,  2540 

h.  Verify  ChaC  Che  TDWR  provides  Che  NAS  an  alerc  when  selecCed  subsysCem 
parameCers  are  ouCslde  a  predeCermlned  range  wlch  Che  capablllCy  Co  change  Che 
range  or  allow  Che  specialise  Co  disable  chem  on  slCe.  The  disabling  funcClon  will 
be  reporced  as  performance  daca  In  accordance  wlch  Che  following  TVRTM 
requlremenCs : 


2410,  2420,  2421,  2430,  2440,  2510 

1.  Verify  ChaC  Che  TDWR  provides  Che  NAS  subsysCem  cerclflcadon  daCa  In 
response  Co  a  cerClflcaClon  exercise  and  subsysCem  dlagnosclc  daCa  In  response 
Co  a  dlagnosclc  cesc  requesC  In  accordance  wlch  Che  following  TVRTM  requlremenCs: 

2450,  2460,  2520,  2530 
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j .  Verify  that  the  TDWR  provides  NAS  the  capability  for  the  controller  to 
change  the  current  operating  mode  of  any  subsystem  to  any  other  proper  operating 
mode  of  a  subsystem.  The  capability  for  local  input  and  display  of  data  and 
commands  to  a  subsystem  via  the  MDT  shall  be  verified.  The  specialist  can  obtain 
exclusive  control  on  site  upon  request.  The  above  will  be  verified  in  accordance 
with  the  following  TVRTM  requirements: 

2490,  2520,  2560,  2570,  2630,  2640,  2670 

k.  Verify  that  the  TDWR  shall  provide  the  capability  to  measure  system 
performance  factors  in  accordance  with  the  following  TVRTM  requirements: 

2220,  2230,  2240,  2250 

5. 1.2. 2  Evaluation  Criteria. 

The  criteria  for  success  shall  be  the  assurance  that  each  requirement  listed  for 
Category  B  in  the  TVRTM  has  been  satisfied  and  is  in  accordance  with  NAS-SS-1000, 
NAS-MD-790,  NAS-MD-792,  NAS-MD-793,  and  the  TDWR  ICD.  The  pass/fail  determination 
for  each  requirement  will  be  verified  by  test  or  demonstration. 

This  criteria  for  success  shall  be  applied  individually  against  each  objective 
stated  in  section  5. 1.2.1  to  determine  if  the  TVRTM  requirements  have  been  met 
as  defined  below; 

a.  Each  TDWR  communication  between  the  RMS  and  the  MPS  is  correct, 

b.  Each  RMS  status  report  of  the  TDWR  is  correct, 

c.  Each  RMS  response  to  TDWR  generated  equipment  alarm,  state  change,  and 
threshold  change  condition  is  correct, 

d.  Each  TDWR  response  to  diagnostic  and  certification  commands  sent  by  the 
MPS  is  correct, 

e.  Each  TDWR  communication  between  the  MDT  and  the  MPS  is  correct, 

f.  Each  monitoring  of  the  TDWR  by  the  MDT  for  status  is  correct, 

g.  Each  MDT  response  to  TDWR- generated  equipment  alarm,  state  change,  and 
threshold  change  condition  is  correct, 

h.  Each  MDT  command  given  to  the  TDWR  is  correct, 

i.  Each  TDWR  response  to  diagnostic  and  certification  commands  sent  by  the 
MDT  is  correct. 

5. 1.2. 3  Test  Configuration. 

Verification  Category  C  test  configuration  is  as  shown  in  figure  5. 1.2. 3-1. 
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FIGURE  5. 1.2. 3-1.  CATEGORY  B  -  TDWR/RMMS  INTERFACE 
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The  following  support  hardware  will  be  required  for  Category  B  testing: 

a.  HPS 

b.  MDT 

5.1.2.5  Support  Software. 

The  following  support  software  will  be  required  for  Category  B  testing: 

TBD 

5 .1.2 .6  Special  Test  Equipment. 

The  following  special  test  equipment  will  be  required  for  Categoxry  B  testing: 

a.  Base  Data  Recorder 

b.  Time  Series  Recorder 

c .  GFE  Modems 

5 .1.2 .7  Data  Analysis. 

Test  data  will  be  gathered  by  designated  test  team  members  from  test  logs,  printer 
outputs,  and  storage  devices  (disk  drives,  tape  drives,  etc).  The  data  will  be 
analyzed  in  detail  to  provide  a  comprehensive  analysis  of  the  TDWR. 

Actual  inputs  shall  be  analyzed  against  actual  outputs  to  determine  if  appropriate 
responses  were  generated  in  accordance  with  the  TVRTM  requirements.  These 
requirements  include  information  which  specifies  response  times.  Data  throughput 
response  times  will  be  analyzed.  Also,  outputs  will  be  compared  against  related 
docvunentation  to  verify  the  output  data  is  correct.  Any  discrepancies  will  be 
noted  and  documented. 

Data  is  to  be  recorded  during  each  section  of  the  test.  The  data  will  be  stored 
in  data  files  and  the  names  of  the  data  files  will  be  clearly  marked  in  the  test 
procedures.  These  files  will  be  recorded  in  computers  for  later  transfer  to 
360  kilobytes  (Kb)  floppy  disks. 

Data  will  be  analyzed  during  test  conduct  to  insure  that  the  tests  are  proceeding 
as  predicted.  In  addition,  all  data  will  be  thoroughly  analyzed  after  the  fact  to 
insure  that  all  discrepancies  are  noted  and  properly  addressed.  A  major  part  of 
the  data  analysis  will  involve  comparing  data  on  more  than  one  device  to  verify 
accuracy  of  data  transfer  and  timeliness  of  command/response.  All  data  files  will 
be  retained  in  the  test  package.  The  data  recorded  for  the  run  record  will  be 
retained  in  both  hard  copy  and  soft  copy.  The  data  will  be  clearly  annotated  as  to 
collection  details  and  the  hard  copy  will  be  appended  to  the  final  test  report. 

Data  is  to  be  recorded  during  each  section  of  the  test  into  files.  These  files 
will  be  recorded  on  the  computers  and  simulators  to  be  stored  on  360  Kb  floppies. 
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5.1.2.8  Documentation. 

The  following  reference  material  will  be  made  available  to  appropriate  personnel 
prior  to  test  conduct. 

TDWR  Master  Test  Plan 

TDWR  OT&E  Integration  Test  Plan 

TDWR  OT&E  Integration  Test  Procedures 

NAS-IC-31055103-00  -  TDWR  (RMS)/MPS  Interface  Control  Document  (ICD) 

NAS- IC- 31055104-00  -  TDWR/MDT  ICD 
NAS -MD- 790  -  RMMS  ICD 

NAS -MD- 792  -  Operational  Requirements  for  the  RMMS 
NAS -MD- 793  -  RMMS  Functional  Requirements  for  the  RMS 
NAS-SS-1000  -  NAS  System  Specification 
FAA-E-2806a  -  TDWR  Specification 

5.1.3  CATEGORY  C  -  END- STATE  SYSTEM  LEVEL  TEST. 

Verification  Category  C  will  be  performed  to  demonstrate  compliance  with 
functional,  performance,  and  physical  requirements.  This  test  will  demonstrate 
TDWR  operational  effectiveness  and  the  functionality  of  the  displays.  It  will 
provide  evaluation  of  response  times  and  output  formats . 

5. 1.3.1  Test  Objectives. 

a.  Verify  that  the  TDWR  has  the  capability  to  collect  and/or  sense  weather 
information,  to  identify  and  classify  weather  phenomena,  to  analyze  and  process 
return  signals,  to  generate  weather  products  and  weather  maps,  and  to  provide 
displays  in  accordance  with  the  following  TVRTM  requirements; 

3010,  3020,  3030,  3040,  3090,  3110,  3120, 

3121,  3122,  3123,  3130,  3131,  3132,  3140, 

3141,  3142,  3143,  3150,  3151,  3152,  3153, 

3154,  3155,  3156,  3310 

b.  Verify  that  the  TDWR  has  the  capability  to  disseminate  weather  products 
and  alert  messages  to  interfaces  and  subsystems  in  accordance  with  the  following 
TVRTM  requirements: 

3170,  3171,  3180,  3181,  3290,  3291 

c.  Verify  that  the  TDWR  has  the  capability  to  detect  weather  within  specified 
parameters,  resolutions,  and  accuracies  in  accord '■T’ce  with  the  following  TVRTM 
requirements: 

3190,  3191,  3192,  3210,  3211,  3212,  3220, 

3221,  3222,  3230 


d.  Verify  that  the  TDWR  has  the  capability  to  archive  derived  products  and 
weather  information  in  accordance  with  the  following  TVRTM  requirements; 


e.  Verify  that  the  TDWR  has  the  capability  to  operate  within  a  specified 
frequency  in  accordance  with  the  following  TVRTM  requirement: 

3240 

f.  Verify  that  the  TDWR  has  the  capability  to  generate  alert  messages  when 
prespecified  threshold  conditions  occur  in  accordance  with  the  following  TVRTM 
requirements : 


3160,  3270 

g.  Verify  that  the  TDWR  has  the  capability  to  detect  weather  information  and 
provide  weather  data  within  specified  times  in  accordance  with  the  following  TVRTM 
requirements : 


3060,  3070,  3080,  3250,  3270,  3280 

5.1. 3.2  Evaluation  Criteria. 

The  evaluation  for  success  shall  be  the  assurance  that  each  requirement  listed  for 
Category  C  in  the  TVRTM  has  been  satisfied  and  is  in  accordance  with  NAS-SS-IOOO. 
The  pass/fall  determination  for  each  requirement  will  be  verified  by  test  or 
demonstration. 

This  criteria  for  success  shall  be  applied  individually  against  each  objective 
stated  in  section  5. 1.3.1  to  determine  if  the  TVRTM  requirements  have  been  met, 
as  defined  below; 

a.  Each  TDWR  display  (both  GSD  and  RDT)  reflects  the  correct  weather 
phenomena  and  alert  message, 

b.  Each  TDWR  archived  data  slice  is  correct, 

c.  The  TDWR  operating  frequency  is  correct, 

d.  Each  specified  parameter,  resolution,  and  accuracy  of  the  TDWR  is  correct. 

5 .1.3. 3  Test  Configuration. 

Verification  Category  C  test  configuration  is  as  shown  in  figure  5. 1.3. 3-1. 

5.1. 3.4  _ Support  Hardware. 

The  following  support  hardware  will  be  required  for  Category  C  testing: 

a.  TCCC  (or  simulation) 

b.  GSD 

c.  RDT 

5. 1.3.5  Support  Software. 

The  following  support  software  will  be  required  for  Category  C  testing: 

TBD 
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FIGURE  5. 1.3. 3-1.  CATEGORY  C  -  END-STATE  SYSTEM  LEVEL  TEST 
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5. 1.3. 6  Special  Test  Equipment. 

The  following  special  test  equipment  will  be  required  for  Category  C  testing: 


a. 

Archive  Data  Recorder 

b. 

Base  Data  Recorder 

c . 

Time  Series  Recorder 

d. 

GFE  Modems 

e . 

Hard  Copy  to  GSD  and  RDT 

5.1.3.J_ 

Data  Analysis. 

Test  data  will  be  gathered  by  designated  test  team  members  from  test  logs,  printer 
outputs,  and  storage  devices  (disk  drives,  tape  drives,  etc.).  The  data  will  be 
analyzed  in  detail  to  provide  a  comprehensive  analysis  of  the  TDWR. 

Actual  inputs  shall  be  analyzed  against  actual  outputs  to  determine  if  appropriate 
responses  were  generated  in  accordance  with  the  TVRTM  requirements .  These 
requirements  include  information  which  specifies  response  times.  Data  throughput 
response  times  will  be  analyzed.  Also,  outputs  will  be  compared  against  related 
documentation  to  verify  the  output  data  is  correct.  Any  discrepancies  will  be 
noted  and  documented. 

Data  is  to  be  recorded  during  each  section  of  the  test.  The  data  will  be  stored 
in  data  files  and  the  names  of  the  data  files  will  be  clearly  marked  in  the  test 
procedures.  These  files  will  be  recorded  in  computers  for  later  transfer  to 
360-Kb  floppy  disks. 

Data  will  be  analyzed  during  test  conduct  to  insure  that  the  tests  are  proceeding 
as  predicted.  In  addition,  all  data  will  be  thoroughly  analyzed  after  the  fact  to 
Insure  that  all  discrepancies  are  noted  and  properly  addressed.  A  major  part  of 
the  data  analysis  will  involve  comparing  data  on  more  than  one  device  to  verify 
accuracy  of  TDWR  displays  and  timeliness  of  command/response.  The  data  recorded 
for  the  run  record  will  be  retained  in  both  hard  copy  and  soft  copy.  The  data  will 
be  clearly  annotated  as  to  collection  details  and  the  hard  copy  will  be  appended  to 
the  final  test  report. 

Data  is  to  be  recorded  during  each  section  of  the  test  into  files.  These  files 
will  be  recorded  on  the  computers  and  simulators  to  be  stored  on  360-ICb  floppies. 

5. 1.3. 8  Documentation. 

The  following  reference  material  will  be  made  available  to  appropriate  personnel 
prior  to  test  conduct: 

TDWR  Master  Test  Plan 
TDWR  OT&E  Integration  Test  Plan 
TDWR  OT&E  Integration  Test  Procedures 
NAS -SS- 1000  -  NAS  System  Specification 
FAA-E-2806a  -  TDWR  Specification 
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6.  TDWR  INTEGRATION  TESTING  ORGANIZATIONAL  ROLES  AND  RESPONSIBILITIES. 


The  FAA  Technical  Center  is  the  organization  responsible  for  conducting  OT&E 
Integration.  The  FAA  Technical  Center  (ACW-200)  has  the  overall  responsibility  for 
the  conduct  and  coordination  of  the  evaluation.  The  specific  responsibilities  of 
the  FAA  Technical  Center  are  listed  below. 

6.1  TDWR  TEST  MANAGEMENT  GROUP. 

The  function  of  the  TDWR  Test  Management  Group  is  to  direct  all  test  efforts 
relative  to  OT&E  Integration.  This  group  will  be  comprised  of  representatives  from 
the  FAA  and  their  support  contractors.  Specific  responsibilities  of  the  Test 
Management  Group  are  as  follows; 

a.  Establish  policies  related  to  TDWR  OT&E  Integration  activities. 

b.  Concur  with  all  test  plans  and  procedures  related  to  TDWR  OT&E  Integration 
activities . 

c.  Distribute  TDWR  OT&E  Integration  related  docvimentation  to  all 
participating  organizations  for  review. 

d.  Assign  roles  and  responsibilities  to  the  TDWR  Test  Support  Group. 

The  TDWR  Test  Management  Group  will  coordinate  and  assign  particular  tasks  to  each 
organization  represented  in  the  TDWR  Test  Support  Group.  Each  organization  will  be 
responsible  for  accomplishing  assigned  tasks  and  personnel  assignments. 

6.2  TDWR  TEST  SUPPORT  GROUP. 

The  TDWR  Test  Support  Group  will  consist  of  a  group  of  specialists  who  are 
knowledgeable  in  specific  technical  areas.  The  role  of  this  group  will  be  to 
support  the  TDWR  Test  Management  Group  in  developing  test  requirements,  plans, 
procedures,  scenarios,  and  other  test  support  tools.  This  group  will  also  conduct 
tests,  perform  test  analysis,  and  produce  test  reports. 

Personnel  from  this  group  will  provide  the  services  necessary  to  establish, 
schedule,  maintain,  and  control  the  activities  of  the  TDWR  OT&E  Integration  effort. 
A  detailed  schedule  will  be  provided  prior  to  the  start  of  the  test  period. 

The  TDWR  Test  Support  Group  will  be  comprised  of  personnel  from  organizations  shown 
in  table  6.2-1.  Responsibilities  of  the  members  are  also  noted.  A  summation  of 
the  responsibilities  associated  with  the  support  group  include,  but  are  not  limited 
to,  the  following; 

a.  Conduct  or  participate  in  TDWR  OT&E  Integration; 

b.  Maintain,  analyze,  and  report  test  results; 

c.  Perform  assigned  test  roles  as  directed  by  the  TDWR 
Test  Management  Group. 
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TABLE  6.2-1. 


TDWR  TEST  SUPPORT  GROUP  RESPONSIBILITIES 


GOVT/FAA 

ACW-200 


ASM-630 


ATR-120/ 

AF.  AT  Field 
Site 

Personnel 

Integration 


ATQ-1 


SUPPORT 

CONTRACTOR 

Systems  Engineering 
and  Integration 
Contractor  (SEIC)  - 
Technical 


PRIMARY  ROLES /FUNCTIONS 

Test  Program  Manager  (ACW-200)  shall  provide  overall 
coordination  and  direction  of  the  TDWR  OT&E  Integration. 
ACW-200  will  serve  as  a  single  point  of  control  for  each 
aspect  of  the  testing  defined  in  this  plan.  ACW-200  will 
maintain  test  logs  and  issue  final  test  reports.  ACW-200 
will  prepare  the  OT&E  Integration  Test  Plan  and  Test 
Procedures,  conduct  OT&E  Integration,  participate  in  TDWR 
status  and  review  meetings  as  directed,  and  publish  an  OT&E 
Integration  Final  Report. 

Provide  assistance  and  support  to  the  implementation  of  this 
plan  by  reviewing  the  OT&E  Integration  Test  Plan,  Test 
Procedures,  test  data  and  test  reports,  and  by  providing 
personnel  to  serve  as  members  of  the  TDWR  OT&E  Integration 
test  team  for  test  operations  and  test  analysis.  ASM-630 
will  perform  Shakedown  Testing. 

Provide  assistance  and  support  to  the  implementation  of 
this  test  plan  by  reviewing  the  OT&E  Integration  Test  Plan, 
Test  Procedures,  test  data  and  test  reports,  and  by 
providing  personnel  to  serve  as  members  of  the  TDWR  OT&E 
Integration  test  team  for  test  operations  and  test  analysis. 

Serve  as  members  of  the  TDWR  OT&E  Integration  test  team  for 
test  monitoring,  test  observation,  and  test  analysis.  This 
will  allow  for  initial  training  and  a  preliminary  assessment 
of  the  effectiveness  and  suitability  of  the  TDWR  in  an 
operational  environment. 

Review  the  OT&E  Integration  Test  Plan,  Test  Procedures,  test 
data,  and  test  reports.  They  shall  also  observe  tests, 
attend  all  briefings,  status  meetings,  and  review  meetings. 


PRIMARY  ROLES /FUNCTIONS 


Support  ACW-200  in  TDWR  OT&E  Integration  activities, 
as  directed  by  ACW-200. 


6.3  TDWR  OT&E  INTEGRATION  TEST  STRUCTURE /MANAGEMENT. 


The  hlerarchal  structure  of  personnel  for  the  TDWR  OT&E  Integration  activities,  as 
well  as  the  details  necessary  to  discern  the  management  of  test  operations,  are 
presented  in  the  following  subsections. 

6. 3.1.  Definition  of  Roles. 

The  defined  roles  for  conducting  the  TDWR  OT&E  Integration  efforts  are  presented 
below.  It  is  important  to  note  that  all  positions  will  not  necessarily  have  to  be 
manned  for  every  test.  Figure  6.3. 1-1  presents  the  hierarchy  structure  of  the  test 
team. 

6. 3 .1.1  TDWR  Associate  Program  Manager  for  Test 

The  Associate  Program  Manager  for  Test  (APMT)  is  responsible  for  ensuring  that  all 
test  requirements  are  satisfied  and  that  tests  are  performed  in  accordance  with 
approved  procedures.  The  APMT  also  directs  and  conducts  OT&E  Integration  and 
Operational  tests.  The  APMT  responsibilities  have  been  delegated  to  ACW-200  for 
the  TDWR  test  efforts. 

^.3,1,2 _ TDWR  Test  Director  (ACW-200). 

The  Test  Director  is  responsible  for  the  overall  management  of  the  TDWR  OT&E 
Integration  test  effort  and  shall  provide  management  guidance  through  the  Test 
Coordinators  and  other  members  of  the  test  team.  Test  Director  authority  and 
responsibilities  have  been  delegated  to  ACW-200  for  TDWR  test  efforts. 

6. 3. 1.3  _ TDWR  Test  Coordinator  (ACW-200). 

The  Test  Coordinator  is  responsible  for  the  overall  TDWR  test  coordination  to 
ensure  that  individual  missions  are  properly  structured  and  mission  objectives  are 
accomplished.  The  Test  Coordinators  will  select  the  appropriate  Test  Managers 
based  upon  suitability,  expertise,  and  availability.  The  Test  Managers  will  work 
with  the  Test  Director  on  unresolved  problems,  recommend  remedial  action,  and 
provide  general  support  to  the  Test  Director.  The  Test  Coordinator  shall  have  the 
responsibility  to  ensure  that  the  appropriate  level  of  software  necessary  for 
testing  is  available. 

6. 3.1.4  TDWR  Test  Manager  (ACW-200). 

The  Test  Manager  will  coordinate  scheduling  of  the  system  support  facility  and 
other  test  support  facilities.  There  will  be  one  Test  Manager  per  test  to  ensure 
that  required  equipment  and  personnel  are  available  prior  to  the  start  of  the  test. 
The  Test  Manager  shall  also  conduct  the  pre-  and  post- test  review  for  the  test,  as 
well  as  oversee  the  collection  of  all  applicable  data  for  subsequent  analysis. 

This  individual  will  maintain  the  ultimate  authority  over  the  specific  test 
assigned.  During  the  actual  test,  the  Test  Manager  will  verify  adherence  to  the 
test  procedures.  He  will  be  responsible  for  controlling  the  Test  Discrepancy 
Reports  and  for  insuring  that  the  test  conduct,  mission  logs,  and  summary  forms  are 
completed  by  the  Test  Monitors.  He  shall  collect  all  recorded  data  upon  test 
completion.  The  Test  Manager  shall  keep  the  Test  Coordinators  appraised  of  test 
results  and  ensure  that  all  deficiencies  are  noted. 
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FIGURE  6. 3. 1-1.  TDWR  0T4E  INTEGRATION  TEST  TEAM 
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6.3.1.5  TDWR  Test  Monitors  (ACW-200.  ASM- 630.  ATO-1.  Contractors')  . 

The  TDWR  Test  Monitors  will  be  responsible  for  ensuring  that  test  scenarios  and 
procedures  are  being  followed  by  each  Test  Operator.  Test  Monitors  will  assist  the 
Test  Manager  in  verifying  that  test  data  flow  observations  and/or  test  measurements 
are  recorded  at  each  identifiable  test  point.  Test  Monitors  will  report  to  the 
Test  Manager  and  will  be  required  to  maintain  and  complete  Test  Observer/Monitor 
Notes . 

6. 3. 1.6  TDWR  Test  Observers  (ACW-20Q.  ASM-630.  ATR-240.  ATO-1.  SEIC  Contractors). 

If  necessary,  technically  qualified  Test  Observers  will  be  assigned  to  monitor  and 
record  activities  for  specific  test  procedures  and  to  provide  assistance  to 
personnel  manning  the  test  positions.  Test  Observers  will  also  maintain  Test 
Observer/Monitor  Notes . 

6. 3. 1.7  TDWR  Test  Operators  f ACW-200.  ASM-630.  AT  and  AF  Field  Site  Personnel. 
Contractors') . 

The  TDWR  Test  Operators  will  be  personnel  assigned  to  man  the  test  positions  during 
a  particular  test.  They  will  be  expected  to  follow  the  order  of  the  test,  record 
test  anomalies,  and,  if  necessary,  request  assistance  from  the  Test  Observers.  For 
the  conduct  of  these  tests,  the  Test  Operator  will  be  under  the  direct  supervision 
of  the  Test  Manager.  In  addition.  Computer  Operators  will  fall  under  this  category 
and  will  assist  in  bringing  up  the  system,  setting  up  the  test,  and  responding  to 
system  interrupts  during  run  execution.  The  Computer  Operators  will  assist  in 
gathering  run  hardcopy  and  executing  all  data  reduction  jobs,  indicated  by  the  Test 
Manager,  required  for  analysis  of  the  test. 

6.4  TDWR  OT&E  INTEGRATION  RESOURCE  REQUIREMENTS. 

The  following  subsections  define  resource  requirements  for  facilities  and  personnel 
to  support  the  TDWR  OT&E  Integration. 

6.4.1  TDWR  OT&E  Integration  Facility  Requirements. 

TBD 

6.4.2  TDWR  OT&E  Integration  Personnel  Requirements. 

The  following  subsections  define  the  number  and  type  of  personnel  that  will  be 
required  for  OT&E  Integration. 

6. 4. 2.1  TDWR  OT&E  Integration  Test  Management  Group. 

Test  management  will  be  accomplished  by  the  TDWR  Test  Management  Group  described  in 
section  6.1. 

6. 4. 2. 2  TDWR  OT&E  Integration  Test  Support  Personnel. 

A  list  of  the  number  and  type  of  the  support  personnel  that  is  required  to  conduct 
and  evaluate  the  TDWR  OT&E  Integration  is  shown  in  table  6.4. 2. 2-1. 
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TABLE  6. 4. 2. 2-1.  TDWR  OT&E  INTEGRATION  TEST  SUPPORT  PERSONNEL 


GOVERNMENT 

PERSONNEL  NUMBER  OF  PEOPLE  POSITION 


ACW-200 

1 

Test  Coordinator 

ACW-200 

1 

Test  Manager 

ACW-200 

2 

Test  Monitor 

AT  Field  Personnel 

1-2 

Test  Operator 

AF  Field  Personnel 

1-2 

Test  Operator 

ASM- 630 

1-2 

Test  Operator 

ACW-200 

1 

Test  Operator 

ACW-200 

3 

Test  Operator 

ATQ-1 

1 

Test  Observer 

SUPPORT  CONTRACTORS 

SEIC 

1-2 

Test  Observer 

Note:  Test  Monitor,  Test  Operators,  and  Test  Obseirvers  shall  be  utilized  to 
perform  data  analysis. 


7.  TDWR  OT&E  INTEGRATION  DOCUMENTATION  REQUIREMENTS  AND  CONTROL. 


This  section  identifies  the  test  documentation,  reviews,  and  reports  that  are 
necessary  for  TDWR  OT&E  Integration. 

7.1  DOCUMENTATION. 

The  required  documents  for  planning,  conducting,  and  reporting  the  TDWR  OT&E 
Integration  activities  are  presented  below.  Figure  7.1-1  illustrates  the  sequence 
of  documentation  preparation,  while  table  7.1-1  identifies  responsibility  for  each 
product  and  when  it  is  to  be  completed. 

7.1.1  TDWR  OT&E  INTEGRATION  TEST  PLAN. 

This  plan  establishes  the  specific  test  configurations,  verification  categories, 
critical/noncritical  issues,  objectives,  schedules,  resource  requirements,  test 
methodology,  and  test  management  organization.  It  contains  the  TVRTM  which  defines 
the  NAS-SS-IOOO  system  requirements. 

7.1.2  TDWR  OT&E  Integration  Test  Procedures. 

The  Test  Procedures  will  contain  step-by-step  instructions  for  testing  the 
requirements  associated  with  each  verification  category.  These  procedures  shall  be 
produced  and  executed  to  determine  whether  the  TDWR  system  meets  the  appropriate 
NAS  requirements.  They  will  be  developed  by  ACW-200  and  will  be  written  in 
accordance  with  FAA-STD-024a,  appendix  III. 
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FIGURE  7. 


-1.  TDWR  OT&E  INTEGRATION  TEST  DOCUMENTATION  FLOW 


28 


TABLE  7.1-1.  TEST  FORM/DOCUMENT/REPORT  MATRIX 


FORMS /DOCUMENTS /REPORTS 

WHEN  COMPLETED 

RESPONSIBILITY 

OT&E  Integration  Test  Plan 

12/90 

ACW-200 

OT&E  Integration  Test  Procedures 

06/91 

ACW-200 

Computer  and  Facility  Req.  Forms 

Prior  To  Test 

Test  Manager 

Test  Mission  Log 

Pretest  Review 

Test  Manager 

Test  Service  Report 

During  Test 

Test  Manager 

Test  Monitor  Notes 

During  Test 

Test  Monitor 

Test  Observer  Notes 

During  Test 

Test  Observer 

Test  Conduct  Log 

During  Test 

Test  Manager 

Test  Summary  Form 

Post-Test  Review 

Test  Manager 

Post-Test  Briefing  Package 

Post-Test  Review 

Test  Manager 

Quick  Look  Test  Report 

10  Days  After  Test 

Test  Manager 

Test  Evaluation  Summary 

Following  Data  Analysis 

Test  Coordinator 

Final  Test  Report 

30  Days  After  OT&E  Integ. 
is  completed 

Test  Director 

7. 1.3.  Test  Doctiments. 

Test  Conduct  Logs  will  be  used  by  each  of  the  Test  Monitors  and  Operators  to  record 
test  events.  The  Test  Manager  shall  be  responsible  for  obtaining  these  logs  at  the 
conclusion  of  the  test. 

Test  Observer  and  Monitor  Notes  will  be  used  by  each  of  the  Test  Observers  and 
Monitors  to  record  all  relevant  events  occurring  during  the  test.  These  notes  will 
provide  information  that  will  contribute  to  the  initial  test  assessment. 

Examples  of  Test  Conduct  Logs,  Test  Observer  Notes,  and  Test  Monitor  Notes  will  be 
Included  in  the  OT&E  Integration  Test  Procedures. 

7.1.4  Post-Test  Documents. 

In  the  Post-Test  Review,  the  Test  Summary  Forms  shall  be  completed  by  the  Test 
Manager.  During  this  time,  a  preliminary  assessment  of  the  test  shall  be  discussed 
as  well  as  the  anomalies  and  deviations  that  were  noted  during  the  test. 

Following  data  analysis.  Test  Evaluation  Summaries  will  be  used  to  record 
information  relevant  to  post- test  evaluation.  The  summaries  will  be  maintained 
by  the  Test  Coordinator  and  will  include  the  following:  (1)  test  identification, 

(2)  purpose  of  the  evaluation,  (3)  data  to  be  evaluated,  (4)  evaluation  method, 
and  (5)  evaluation  results. 

Examples  of  the  Test  Svimmary  Forms  and  the  Test  Evaluation  Summaries  will  be 
included  in  the  OT&E  Integration  Test  Procedures. 

7.2  REPORT  DOCUMENTATION. 

The  following  subsections  define  the  necessary  reports  that  will  be  generated  for 
OT&E  Integration  (see  table  7.1-1). 
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For  each  test  conducted,  a  Quick  Look  Test  Report  will  be  produced  by  the  Test 
Manager  and  will  be  provided  to  the  Test  Director  within  10  working  days  after  test 
completion.  This  report  will  give  the  early  status  information  for  the  system 
while  the  analysis  process  is  still  underway.  It  will  provide  an  immediate 
indication  of  the  outcome  of  a  test  and  highlight  test  discrepancies  noted  during 
test  execution  and  their  significance. 

The  Quick  Look  Test  Report  will  contain  the  following: 

a.  A  completed  Quick  Look  Test  Report  cover  page. 

b.  The  post-test  briefing  package  (described  in  section  7.3.4). 

c.  Minutes  of  the  post-test  briefing. 

7.2.2  Final  Test  Report. 

The  TDWR  Test  Director  will  be  responsible  for  preparing  a  Final  Test  report. 

A  "Draft"  report  will  be  delivered  to  the  Program  Manager  30  days  after  the 
completion  of  OT&E  Integration.  The  Final  Test  Report  will  document  the  results 
of  detailed  test  analysis,  and  assess  the  compliance  of  each  test  to  defined 
criteria.  The  status  of  problems  identified  previously  in  the  Quick  Look  Test 
Reports  will  be  updated.  A  revised  assessment  will  be  made  of  their  impact  on 
the  tested  system  and  the  suggested  corrective  actions  required. 

Any  new  problems  discovered  by  detailed  evaluation  will  be  identified  and  their 
impact  in  the  system  described. 

The  Final  Test  Report  will  contain  the  following: 

a.  Description  of  the  test  configurations. 

b.  Reference  to  the  applicable  test  plan  and  procedures. 

c.  Identification  of  the  specific  tests  and  the  dates  of  the  test  runs. 

d.  The  purpose  of  the  tests. 

e.  The  specific  test  objectives,  including  reference  to  applicable 
requirements  and  specifications. 

f.  A  list  of  all  test  equipment,  including  manufacturer,  model,  calibration, 
status,  and  serial  number. 

g.  A  description  of  the  evaluation  criteria  used  for  each  test,  including  the 
range  of  data  and  parameter  values  tested. 

h.  A  svunmary  of  the  results  of  each  test.  A  matrix  will  also  be  included 
that  translates  the  test  results  into  the  success  criteria  and  compares  it  with  the 
specification  requirement. 
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1.  Detailed  test  results  listing  the  results  of  the  test  based  on  the  data 
collected  during  the  test.  For  each  step  of  a  test  procedure  where  a  discrepancy 
occurred,  identification  of  the  procedure  step  number,  the  expected  response,  the 
actual  response,  the  significance  of  the  discrepancy,  and  the  impact  of  the 
discrepancy  on  the  validity  of  preceding  or  following  steps  of  the  test  procedure, 
shall  be  provided.  Associated  information  should  be  included. 

If  individual  trouble  reports  are  prepared,  these  may  be  referenced  in  the 
test  report  in  lieu  of  repeating  their  information. 

j.  A  summation  of  the  problems  and  their  status. 

k.  Test  Evaluation  -  An  overall  analysis  of  the  performance  of  the  article 
tested  will  be  provided.  This  analysis  will  describe  the  functional  and 
operational  capability  as  demonstrated  in  the  testing.  If  applicable,  this  section 
will  include  assessment  of  the  manner  in  which  the  test  environment  is  different 
from  the  operational  environment,  and  its  effect  on  the  functional  performance 
capability.  A  general  statement  will  be  provided  for  each  operational  deficiency, 
and  the  impact  on  the  system  if  the  deficiency  is  not  corrected. 

7.2.3  Test  Service  Reports. 

The  Test  Manager  shall  ensure  all  test  discrepancies  and  problems  observed  during 
testing  are  documented.  The  Service  Report  shall  be  used  to  document  these  test 
discrepancies  and  problems.  These  Service  Reports  will  go  to  the  Program  Office 
for  resolution.  An  example  of  the  Service  Report  will  be  included  in  the  OT&E 
Integration  Test  Procedures. 

7 . 3  REVIEWS . 

The  following  subsections  identify  the  types  of  reviews  and  meetings  that  will  be 
conducted  prior  to,  during,  and  after  OT&E  Integration.  Table  7.3-1  presents  each 
of  these  events,  as  well  as  the  responsibility  to  which  they  are  assigned. 


TABLE  7.3-1.  TEST 


TEST  REVIEWS 

Weekly  Status  Review 
Monthly  Status  Review 
Notification  of  Test  Letter 
Test  Readiness  Review 
Pretest  Review 
Post-Test  Review 
Deployment  Readiness  Review 


REVIEW  AND  MEETING  MATRIX 


RESPONSIBILITY 

ACW-200 
ACW-200 
Test  Director 
Test  Director 
Test  Manager 
Test  Manager 
Program  Manager 
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7.3.1  Notification  of  Test  Letter. 

A  Notification  of  Test  Letter  will  be  prepared  by  the  TDWR  Test  Director  and 
submitted  to  the  ANR-500  Program  Manager  prior  to  the  start  of  the  Test  Readiness 
Review  (TRR)  for  OT&E  Integration.  Copies  will  go  to  participating  organizations. 
This  notification  letter  will  contain  the  following  information  concerning  the 
upcoming  test: 

a.  Scheduled  date,  time,  and  place  for  the  TRR. 

b.  The  specific  tests  that  are  to  be  run. 

7.3.2  Test  Readiness  Review  (TRR^ . 

Two  weeks  prior  to  the  start  of  the  first  test,  a  Test  Readiness  Review  will  be 
conducted  by  the  TDWR  Test  Director  to  assess  the  readiness  to  begin  OT&E 
Integration. 

7.3.3  Pretest  Review. 

This  review,  chaired  by  the  Test  Manager,  will  be  scheduled  immediately  prior  to 
the  start  of  the  test  and  will  be  attended  by  all  test  personnel.  The  review  will 
Include  the  status  of  prerequisites,  software  and  system  equipment  (TDWR  and  other 
systems  and  facilities),  and  a  test  summary.  The  pretest  briefing  will  also 
accomplish  the  following; 

a.  Identify  any  needed  changes,  and  mark  up  the  procedures  accordingly. 

b.  Review  the  hardware  and  software  configurations  of  the  environment. 

c.  The  Test  Manager  will  ensure  that  all  items  in  the  material  checklist 
(contained  in  the  Test  Procedures)  have  been  received. 

d.  Provide  Test  Problem  Report  (TPR)  forms  to  attendees. 

e.  Generate  a  record  of  the  pretest  briefing  on  a  TDWR  Test  Briefing  Minutes 

form. 

7.3.4  Post-Test  Review. 

This  review  will  be  held  upon  test  completion.  It  will  be  chaired  by  the  Test 
Manager  and  attended  by  the  full  test  team.  This  meeting  will  review  the  results 
of  the  test  activity.  An  assessment  of  the  quality  of  the  test,  TPRs,  and  the 
impact  of  problems  encountered  will  be  discussed  during  the  review  of  the  Test 
Manager's  post- test  briefing  package. 

In  the  post- test  review,  the  Test  Manager  will  prepare  a  post- test  briefing 
package.  The  package  will  include  the  following: 

a.  The  "as-run"  hardware  and  software  configuration,  how  it  differed  from 
that  stated  in  the  procedures  and  its  significance  to  the  test  results. 

b.  Any  procedure  step  deviations  and  their  significance  to  the  test  results. 
Procedure  steps  with  problems  noted  and/or  TPRs  initiated  against  them  will  be 
rescheduled  for  retest  as  required. 
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d.  Discrepancies,  anomalies  and  exceptions  recorded  during  the  test,  and 
their  significance  to  the  test  results. 

e.  A  summary  of  the  outcome  of  the  test. 

7.3.5  Status  Review  Meetings.  • 

These  review  meetings  will  serve  to  keep  the  TDWR  Test  Support  Group  abreast  of  the 
status  of  OT&E  Integration.  These  meetings  will  be  chaired  by  ACW-200,  and  will 
commence  during  development  of  the  OT&E  Integration  Test  Plan  and  Procedures.  The 
status  reviews  will  serve  as  a  technical  interchange  of  issues  and  concerns.  The 
OT&E  Integration  Test  Plan,  test  procedures,  scenarios,  test  conduct  status,  and 
problems  will  be  addressed. 

7.3.6  Deployment  Readiness  Review  <’DRR). 

A  DRR  will  be  prepared,  scheduled,  and  conducted  in  accordance  with  FAA  Order 
1810. 4B  and  ADL-1,  Interim  Operating  Procedure,  dated  February  1987,  for  NAS 
Programs  Deployment  Readiness  Review  (DRR)  Process .  The  DRR  process  will  provide 
the  status  on  all  of  the  TDWR  project  activities,  identify  open  issues,  and  enable 
the  formulation  of  conclusions  and  recommendations  to  these  issues.  The  DRR  also 
ensures  that  adequate  attention  and  resources  are  focused  on  these  issues  to  ensure 
timely  resolution  to  deployment. 

The  DPR  process  will  begin  16  months  prior  to  delivery  of  the  first  operational 
site.  Individuals  involved  with  the  TDWR  OT&E  Integration  activities  will  support 
the  DRR  process,  as  directed  by  the  Program  Manager. 


8.  TDWR  OT&E  INTEGRATION  TRAINING. 

This  section  presents  the  training  needed  for  the  personnel  participating  in  TFT&E 
activities.  The  TFT&E  is  scheduled  to  run  from  June  through  September  1992. 


8 ■ 1  TRAINING  REQUIREMENTS . 

8.1.1  AT  Operations  and  AF  Maintenance  Training. 

Raytheon  is  required  to  develop,  prepare,  and  validate  an  operational  and  a 
maintenance  training  course  for  field  personnel  and  for  AT  and  AF.  The  AT  training 
course  will  last  1  week  and  be  held  at  the  TDWR  test  site.  The  software  and 
hardware  maintenance  training  courses  will  last  6  weeks  and  be  held  at  the  FAA 
Aeronautical  Center,  OK. 

8.1.2  Test  Team  Training. 

Before  technical  test  and  evaluation  begins,  Raytheon  is  required  to  provide  a  TDWR 
engineer  to  conduct  a  one-time  course  to  familiarize  test-team  personnel  with  the 
TDWR  equipment  including  hands-on  instruction.  This  course  will  enable  test  team 
personnel  to  observe  and  assist  in  the  conduct  of  testing. 
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This  secclon  presents  the  schedules  for  TDWR  OT&E  Integration  Activities.  The  TDWR 
OT&E  Integration  Activities  are  traceable  and  supportive  of  the  TDWR  Project  Master 
Baseline  Schedule. 


9.1  TDWR  OT&E  INTEGRATION  ACTIVITIES  SCHEDULES. 

This  schedule  indicates  the  TDWR  OT&E  Integration  Test  Activity  and  is  shown  in 
figure  9.1-1.  The  schedules  are  developed,  released,  and  controlled  by  the  Test 
Director,  ACW-200.  The  function  of  these  schedules  is  to  provide  schedule 
direction  to  all  TDWR  activities.  They  identify  the  major  tasks  to  be  accomplished 
within  a  given  test  area  (e.g..  Test  Plan  and  Test  Procedures  complete)  and 
identify  test- task  durations,  start-stop  dates,  and  major  training  issues.  These 
schedules  enable  the  Test  Director  to  provide  detailed  test  status  to  the  test 
groups . 
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FIGURE  9.1.1.  TDWR  OT&E  INTEGRATION  ACTIVITIES  (Sheet  3  of  4) 
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FIGURE  9.1.1.  TDWR  OT&E  INTEGRATION  ACTIVITIES  (Sheet  A  of  4) 
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APPENDIX  A 

TDWR  OT&E  INTEGRATION  TVRTM 


The  TDWR  TVRTM  is  the  most  essential  part  of  the  NAS  OT&E  Integration  process.  It 
reflects  all  of  the  TDWR  NAS -SS- 1000  system  requirements  and  will  serve  as  the 
single  tracking  tool  accounting  for  their  verification  throughout  the  integration 
cycle. 

Note:  As  of  this  writing,  the  TCCC  interface  (Category  A)  will  not  be  available 

for  OT&E  Integration  testing  (June  -  September  1992) .  Upon  availability 
of  this  interface,  testing  will  be  planned  and  conducted. 

A- II  COLUMN  DEFINITIONS  AND  UTILIZATION. 


The  following  definitions  and  information  is  provided  for  better  user 
understanding : 


REQT  ID  - 

CAT  - 

RELTD  PARA  - 

NAS -SS- 1000  - 

VOL  - 
C/NC  - 


Unique  requirement  identification  number,  developed 
primarily  for  database  useage  and  for  ease  in  referencing 
within  section  5.0  of  this  plan. 

Verification  category  to  which  the  requirement  has  been 
allocated.  Refer  to  section  5.0  of  this  plan  for  more 
information  on  the  categories . 

Paragraph  numbers  where  the  requirement  can  be  located 
throughout  this  document. 

Primary  paragraph  number  of  the  NAS -SS- 1000  to  where 
requirement  can  be  traced. 

NAS -SS- 1000  volume  number  where  requirement  can  be  found. 

Indicates  critical  or  noncritical  requirements  based  on 
table  3-6  of  NAS -SR- 1000  and  the  cross  reference  matrix  of 
the  NAS  System  Specification. 


REQTS  DESCRIPTION  -  Requirement  statements  per  the  NAS  System  Specification. 


VERF  MTHD  -  Verification  Method.  Denoted  by  either: 

"D"  for  Demonstration  or 
"T"  for  Test. 


(See  section  3.2.2  for  definition.) 


REOT 

10 

CAT 

RELTO 

PARA 

NAS-SS-IOOO 

VOL 

C/NC 

REQTS 

OESCRIPTIOM 

VEtF 

NTD 

1170 

A 

5.1.1 

3.2.1.2.5.1.6 

3 

NC 

Tha  TOM  shall  dlssaainate  weather  products  to  the  TCCC. 

0 

117^ 

A 

5.1.1 

3.2.1.2.S.1.6 

3 

NC 

The  TOWR  shall  dlssaainate  alam  aessages  to  the  TCCC. 

D 

1290 

A 

5.1.1 

3.2.1.2.5.2.10 

3 

NC 

Tha  TDM  shall  dlssaainate  data  to  the  TCCC. 

D 

2110 

B 

5.1.2 

3.2.1. 1.9.1.A 

1 

NC 

The  TDWR  shall  continually  aonitor  subsystca  perfomance  to  obtain 
the  data  needed  by  specialists  for  aaintenance  and  operations 
support. 

0 

2120 

B 

5.1.2 

3.2.1. 1.9.1. a 

1 

NC 

The  TOUR  shall  provide  the  status  of  subsysteas  to  specialists  and 
shall  generate  an  alara  upon  the  deviation  of  designated  paraaeters 
froa  praserlbad  liaits. 

0 

2130 

B 

5.1.2 

3.2.1. 1.9.1. C 

1 

NC 

The  TOUR  shall  provide  the  capability  for  a  specialist  on  site  or  at 
an  off-site  location  to  control  salactsd  subsysteas  for  aaintenance 
purposes. 

D 

2140 

B 

5.1.2 

3.2.1. 1.9.1. 0 

1 

NC 

The  TOUR  shall  provide  the  specialist  the  capability  to  identify  the  0 
line  replaceable  unit  causing  an  equipaent  failure. 

2150 

B 

5.1.2 

3.2.1. 1.9.1.6 

1 

NC 

Tha  TOUR  shall  provida  the  specialist  access  to  the  aonitoring, 
control,  and  data  aanagaaant  capabilities  of  the  TOM  as  required 
and  as  authorized  by  adainistrative  directive. 

D 

2210 

B 

5.1.2 

3.2.1.2.9.A 

1 

NC 

The  TDM  shall  provide  the  capability  to  continually  aonitor  the 
status,  alams/alerts,  and  perfomanca  data  of  selected  subsysteas. 

T 

2220 

B 

5.1.2 

3.2.1.2.9.B 

1 

NC 

Tha  TOM  shall  provide  the  capability  to  detect  and  present  slaras 
and  stats  changes  froa  selected  subsysteas  to  NAS  specialists  within 
an  average  tiae  of  10  seconds  and  a  aaxiaua  tiae  (99th  percentile) 
of  BO  seconds. 

T 

2230 

B 

5.1.2 

3.2.1.2.9.C 

1 

NC 

The  TDM  shall  provide  the  capability  to  execute  control  eonaands 

T 

(ttiat  cauM  ■  state  change)  inltiatad  by  NAS  spaciallsts  within  an 
avarage  tiaa  of  S  ascends  and  a  naxiaua  tins  (99th  psreantile)  of  IS 
saeends. 


2240  a  5.1.2  3.2.1.2.9.0 


NC  The  TOWN  shall  provido  the  capability  to  develop  and  present 
certification,  diagnostic  test,  and  unaanned  facility  data  as 
requaatad  by  NAS  specialists  or  datarelned  In  adaptation  within  an 
average  tiae  of  2  alnutas  and  a  aaxiaua  tiaa  (99th  percentile)  of  10 
ainutas. 


22SO  B  5.1.2  3.2.1.2.9.E 


NC  Tha  TOW  shall  provide  an  acknowladgaaant  to  a  specialist  of  a  T 
subsystea's  receipt  of  a  valid  tost  coaaand,  input  by  the 
specialist,  within  an  average  tiaa  of  IS  seconds  and  a  aaxiaua  tiae 
(99th  percentile)  of  75  sacends. 


A-2 


VERF 

HTO 


2310  B  5.1. 2  30.1.1.1  1  NC  Tha  TOUR  sitall  provid*  for  th*  aonitoring  of  designated  subsystea's  0 

parforaanea  paraaaters. 

2320  B  5.1.2  30.1.1.2  1  NC  Tha  TOUR  shall  provida  subsystca  oparating  status  data  including  D 

configuration  and  aoda  of  operation. 

2330  B  5.1.2  30.1.1.3  1  NC  Tha  TOUR  shall  provide  subaystaa  status  reports  that  contain  only  0 

state  changes  in  response  to  a  subsystea  status  request. 

2331  B  5.1.2  30.1.1.3  1  NC  Tha  TOUR  shall  provide  subsystea  status  reports  that  contain  only  0 

alaras/alcrts  in  response  to  a  subsystea  status  request. 

23C0  B  5.1.2  30.1.1.4  1  NC  The  TOUR  shall  autoaatieally  provide  for  the  accuaulation  of  current  0 

subsystea  status  in  a  local  data  file. 

2341  B  5.1.2  30.1.1.4  1  NC  Tha  TOUR  shall  autoaatieally  provide  for  the  accuaulation  of  current  D 

subsystea  parforaanea  data  in  a  local  data  file. 

2350  B  5.1.2  30.1.1.5  1  NC  The  TOUR  shall  provide  subaystaa  data  in  response  to  requests  froa  0 

RNHS  subsysteas. 

2360  B  5.1.2  30.1.1.6  1  NC  Tha  TOUR  shall  provide  an  alara  whan  any  designated  NAS  subsystea  0 

aonitorad  paraaater.  is  out  of  telaranca. 

2370  B  5.1.2  30.1.1.7  1  NC  Tha  TOUR  shall  provide  an  alara  whan  saoka  in  a  subsystaa  facility  0 

has  occurred  (site  specific). 

2371  B  5.1.2  30.1.1.7  1  NC  The  TOUR  shall  provide  an  alara  whan  fire  in  a  subsystea  facility  0 

haa  occurred  (site  specific). 

2372  B  5.1.2  30.1.1.7  1  NC  Tha  TOUR  shall  provide  an  alara  whan  a  physical  intrusion  into  a  0 

subaystaa  facility  has  occurred  (site  specific). 

2300  B  5.1.2  30.1.1.8  1  NC  Tha  TOUR  shall  provide  an  alara  when  tha  electrical  power  aonitored  0 

paraaaters  are  out  of  tolerance  at  unaanned  facilities  (site 
specif ic). 

2381  B  5.1. 2  30.1.1.8  1  NC  The  TOUR  shall  provide  an  alara  when  HVAC  aonitored  paraaaters  are  0 

out  of  tolerance  at  unaanned  facilities  (site  specific). 

2390  B  5.1.2  30.1.1.9  1  NC  The  TOUR  shall  provide  a  retum-to-noraa I  alara  when  an  initial  0 

alara  condition  is  claared. 

2410  B  5.1.2  30.1.1.10  1  NC  The  TOUR  shall  provide  an  alert  when  selected  subsystea  paraaaters  0 

are  outside  a  predetaminad  range. 

2420  8  5.1.2  30.1.1.11  1  NC  The  TOUR  shell  provide  the  capability  to  set  ranges  for  subsystea  0 

alara  or  alert  paraaetars. 


REOT  RELTO  REOTS 

10  CAT  PARA  NAS-S$<1000  VOL  C/NC  OESCRIPTION 
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REOT 

IB 

CAT 

RELTP 

PARA 

HAS>SS-10CO 

VOL 

C/NC 

RESTS 

DESCRIPTION 

VERf 

NTO 

2«21 

B 

5.1.2 

30.1.1.11 

1 

NC 

Tha  TOWN  shall  prowida  tha  capability  to  changa  rangas  for  subsystaa  D 
alara  or  alart  paraaatars. 

2430 

a 

5.1.2 

30.1.1.12 

1 

NC 

Tha  TMR  ahall  provida  for  tha  disabling  of  a  subsystaa  alara  or 
alart  by  a  spaeialist  on  sita. 

D 

2440 

B 

5.1.2 

30.1.1.13 

1 

NC 

Tha  TOUR  shall  raport  tha  disabling  of  a  subsystaa  alara  or  alert  as 
parforaanea  data. 

D 

2450 

a 

5.1.2 

30.1.1.14 

1 

NC 

Tha  TMR  ahall  provide  subsystaa  certification  data  in  response  to  a 
certification  exercise. 

D 

2460 

B 

5.1.2 

30.1.1.15 

1 

NC 

Tha  TMR  shall  provida  subsystaa  diagnostic  data  in  response  to  a 
diagnostic  test  request. 

D 

2470 

a 

5.1.2 

30.1.1.16 

1 

NC 

Tha  TMR  shall  provide  for  tha  aonitoring  of  electrical  power  and 
HVAC  systaas  in  unaenned  subsystaa  facilities  (site  specific). 

D 

2480 

B 

5.1.2 

30.1.1.17 

1 

NC 

Tha  TOUR  shall  provida  for  the  aonitoring  of  saoke.  fire,  physical 
intrusion/  or  any  other  site  hazard  in  unaennad  subsystea  facilities 
(sita  specific). 

D 

2490 

a 

5.1.2 

30.1.1.18 

1 

NC 

Tha  TOUR  shall  provida  for  tha  control  to  changa  tha  current 
operating  aoda  of  a  subsystaa  to  any  other  proper  operating  aode  of 
a  subsystaa  including  on/off. 

0 

2510 

e 

5.1.2 

30.1.1.19 

1 

NC 

Tha  TOUR  shall  previda  tha  capability  to  adjust  selected  subsystea 
paraaetars. 

0 

2520 

B 

5.1.2 

30.1.1.20 

1 

NC 

TTie  TOUR  shall  provide  tha  capability  to  reset  a  subsystea. 

D 

2521 

B 

5.1.2 

30,1.1.21 

1 

NC 

Tha  TOUR  shall  provide  for  tha  initiation  of  subsystea  diagnostic 
tests  for  tha  purpose  of  fault  isolation. 

D 

2530 

a 

5.1.2 

30.1.1.22 

1 

NC 

Tha  TOUR  shall  provida  for  the  initiation  of  subsystea  certification 

exercises. 

D 

2540 

B 

5.1.2 

30.1.1.23 

1 

NC 

The  TOUR  shall  provide  for  tha  control  of  tha  electrical  power  and 
HVAC  systaa  In  unaannad  facilities  (sita  specific). 

0 

2550 

a 

5.1.2 

30.1.1.24 

1 

NC 

TTm  tour  shall  provide  for  specialist  access  to  the  RIRK  natworh 
through  a  aaintensnea  data  tarainal  with  the  proper  authorization. 

D 

2560 

B 

5.1.2 

30.1,1.25 

1 

NC 

TTm  tour  shall  provida  tha  capability  for  local  input  and  display  of 

D 

data  and  caaaanda  to  a  aubayatM  via  tha  naintananca  data  tarainal. 

1  NC  Tha  TOWI  ahall  previda  tha  apaclallat  tha  capability  to  obtain 
txelualva  control  of  a  aubayataa  uhlla  cm  alto. 


2570  B  5.1.2  30.1.1.26 


D 


REQT 

RELTD 

REQTS 

VCRF 

ID 

CAT 

PARA 

NAS-SS-1000 

VOL 

C/NC 

DESCRIPTION 

HTO 

2610 

0 

5.1.2 

3.2.1.2.5.1.7 

3 

NC 

Tha  TDWR  shall  hava  built-in  raaota  aonitoring  eltaantt  capable  of 
aoni taring  tubayataa  status  and  alama. 

D 

2620 

B 

5.1.2 

3.2.1. 2.5. 1.B 

3 

NC 

Tha  TDWR  shall  ba  capabla  of  supplying  oparational  status. 

D 

2630 

B 

5.1.2 

3.2.1.2.5.1.9 

3 

NC 

Tha  TDWR  shall  accept  and  proeass  oparational  control  eoanands  froa 
valid  axtamal  sourcas. 

0 

2640 

B 

5.1.2 

3.2.1x2.5.1.10 

3 

NC 

Tha  TDWR  shall  accept  and  process  raaota  aaintenance  control' 
coaaands. 

0 

2650 

B 

5.1.2 

3.2.1.2.5.1.11 

3 

NC 

Diagnostic  software  shall  ba  aada  available  for  autoasted  assistance 
for  on-sita  aaintenance. 

0 

2660 

B 

5.1.2 

3.2.1.2.5.1.12 

3 

NC 

Tha  TDWR  shall  receive  and  aaintain  tiaing  synchronized  to  universal 
coordinated  tiaa  to  support  systaa  recording  and  aaintenance  and 
distribution  of  products. 

D 

2670 

B 

5.1.2 

3.2.1.2.5.2.11 

3 

NC 

Tha  TDWR  shall  aonitor  status,  respond  to  coaaands,  generate  alaras, 
and  tranaait  aaintenance  status  as  specified  in  3. 2. 1.1. 4. 2.1, 
3.2.1.1.4.2.2,  3.2.1.1.4.2.3,  and  3.2.1. 1. 4.2.7  of  Voluae  V. 

T 

3010 

C 

5.1.3 

3.2.1. 1. 4.1. B 

1 

NC 

The  TDWR  shall  collect  and/or  sense  weather  infomation  tha' 
pertains  to  tha  area  of  NAS  responsibility  for  terainal  and  en  route 
operations. 

D 

3020 

C 

5.1.3 

3.2.1. 1.4.1. 0 

1 

NC 

The  TDWR  shall  provide  tabular  and  pictorial  displays  of  weather 
inforaation  to  support  tha  specialist. 

0 

3030 

c 

5.1.3 

3.2.1. 1.4.1.S 

1 

NC 

The  TDWR  shell  classify  weather  inforaation  as  hazardous  which  aay 
iapact  flight  operations. 

V 

3040 

c 

5.1.3 

3.2.1. 1.4.1.K 

1 

NC 

The  TDWR  shall  generate  weather  products  which  support  the 
interpretation  of  weather  conditions  by  NAS  specialists  and  users. 

0 

3050 

c 

5.1.3 

3.2.1.1.4.1.N 

1 

NC 

The  TDWR  shall  archive  weather  infomation  for  use  in  event 
rsconstruetion  and  accident  investigation. 

D 

3060 

c 

5.1.3 

3.2.1.2.4.A.1 

1 

NC 

The  TDWR  shall  detect  the  current  surface  weather  conditions  et 
salectad  airports  at  least  once  every  ainute. 

T 

3070 

c 

5.1.3 

3.2.1.2.4.A.1.B 

1 

NC 

Tha  TDWR  shall  detect  the  current  weather  conditions  aloft  at  least 
once  every  5  ainutes  for  all  airepaca  within  the  teminal  area  froa 
ground  level  to  10,000  feet  A8L  within  45  nai  of  designated 
airports. 

T 

3000 

c 

5.1.3 

3.2.1.2.4.B.1.A 

1 

NC 

Tha  TDWR  shall  classify  weather  infomation  as  hazardous  or 

T 

potvitlaily  hatardeu*  within  1  Blnuta  fran  tha  tiaa  It  rtcaivta  tha 
hatardeua  waathar  Inforaatlon. 


T 


REQT 

RELTD 

REQTS 

VERF 

ID 

CAT 

PARA 

NAS-SS-1Q00 

WN. 

C/NC 

DESCRIPTION 

MTO 

3090 

C 

5.1.3 

3.2.1.2.4.E.1 

1 

NC 

Th«  TDM  ttell  parfora  alt  pracaaaing  raquirad  to  produca  and/or 
eoap««ta  a  daaerlptfon  of  tha  current,  trand,  or  predicted  weather 
eonditiona  by  deriving  froa  raw  data  the  products  needed  by 
epaeialiata  and  users. 

0 

3110 

C 

5.1.3 

3.2.1.2.4.E.2 

1 

NC 

Tha  TDM  shall  parfora  all  processing  raquirad  to  produce  snd/or 
coapleta  a  description  of  tha  current,  trend,  or  predicted  weather 
conditions  by  using  autoaated  waathar  detection  systeas. 

0 

3120 

C 

5.1.3 

3.2.1.2.5.1.1.A 

3 

NC 

Tha  TOM  shall  identify  the  prasenca  of  a  aicroburst. 

D 

3121 

C 

5.1.3 

3.2.1.2.5.1.1.B 

3 

NC 

Tha  TOUR  shall  identify  tha  presence  of  a  gust  front. 

D 

3122 

C 

5.1.3 

3.2.1.2.5.1.1.C 

3 

NC 

Tha  TOM  shall  identify  tha  presence  of  wind  shift. 

D 

3123 

C 

5.1.3 

3.2.I.2.5. 1.1.0 

3 

NC 

The  TOUR  shall  identify  the  presence  of  precipitation. 

D 

3130 

C 

5.1.3 

3.2.1.2.5.1.2.A 

3 

NC 

Tha  TOUR  shall  aaasura  and  aaka  estiaates  of  reflectivity. 

D 

3131 

C 

5.1.3 

3.2.1.2.S.1.2.B 

3 

NC 

The  TOUR  shall  aeasura  and  aaka  estiaates  of  aean  radial  velocity. 

D 

3132 

C 

5.1.3 

3.2.1.2.5.1.2.C 

3 

NC 

The  TOUR  shall  aeasure  and  aaka  estiaates  of  spectrua  width. 

D 

3140 

C 

5.1.3 

3.2.1.2.5.1.3.A 

3 

NC 

Tha  TOUR  shall  analyte  return  radar  signals  to  dateraine  the  type  of 
weather. 

D 

3141 

C 

5.1.3 

3.2.1.2.5.1.3.B 

3 

NC 

The  TOUR  shall  analyte  return  radar  signals  to  dateraina  the 
location  of  weather. 

0 

3142 

C 

5.1.3 

3.2.1.2.5.1.3.C 

3 

NC 

Tha  TOUR  shall  analyte  return  radar  signals  to  dateraine  tha 
velocity  of  weather. 

D 

3143 

c 

5.1.3 

3.2.I.2.5. 1.3.0 

3 

NC 

Tha  TOM  shall  analyte  return  radar  signals  to  dateraine  tha 
severity  of  waathar. 

0 

3150 

c 

5.1.3 

3.2.1.2.5.1.4.A 

3 

NC 

The  TDM  shall  generate  a  aicroburst  asp. 

D 

3151 

c 

5.1.3 

3.2.1.2.5.1.4.B 

3 

NC 

Tha  TOM  shall  generate  a  aicroburst  aassaga/slara. 

D 

3152 

c 

5.1.3 

3.2.1.2.5.1.4.C 

3 

NC 

Tha  TOM  shall  generate  a  gust  front  aap. 

D 

3153 

c 

5.1.3 

3.2.I.2.5. 1.4.0 

3 

NC 

Tha  TDM  shall  generate  a  gust  front  aeasaga/alara. 

D 

3154 

c 

5.1.3 

3.2.1.2.3.1.4.E 

3 

NC 

Tha  TDM  shall  ganerata  a  wind  shift  aap. 

D 

3155 

c 

5.1.3 

3.2.1.2.5.1.4.F 

3 

NC 

Tha  TDM  shell  ganerata  a  wind  shift  aassage/alam. 

D 

315« 

c 

5.1.3 

3.2.I.2.5. 1.4.6 

3 

NC 

The  TDM  shall  generate  a  precipitation  aap. 

0 
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REQT 

ID 

CAT 

RELTD 

PARA 

NAS-SS-IQOO 

VOL 

C/NC 

REQTS 

DESCRIPTION 

VERF 

HTO 

3160 

C 

5.1.3 

3.2.1.2.5.1.5 

3 

NC 

Tha  TOUR  shall  ganerata  alara  aassagas  indicating  tha  presence  of 
aieraburst,  gust  front,  wind  shift  whan  prespecifiad  threshold 
conditions  occur. 

0 

3170 

C 

5.1.3 

3.2.1.2.S.1.6 

3 

NC 

Tha  TDUR  shall  dissaainata  weather  products  to  tha  TCCC. 

D 

3171 

C 

5.1.3 

3.2. 1.2.5. 1.6 

3 

NC 

Tha  TDUR  shall  dissaainata  alara  aassagas  to  the  TCCC. 

D 

3180 

C 

5.1.3 

3.2.1.2.5.1.13 

3 

NC 

Tha  TDUR  shall  provide  tha  capability  to  disseainate  weather 
products  to  additional  subsysteas  and  support  future  interfaces. 

D 

3181 

C 

5.1.3 

3.2.1.2.5.1.13 

3 

NC 

Tha  TDUR  shall  provide  tha  capability  to  disseainate  alert  aessages 
to  additional  subsysteas  and  support  future  interfaces. 

0 

3190 

C 

5.1.3 

3.2.1.2.S.2.1 

3 

NC 

Tha  TOUR  shall  detect  hazardous  waather  phenoaena  between  0  and  360 
dagraas  in  aziauth. 

T 

3191 

C 

5.1.3 

3.2.1.2.5.2.1 

3 

NC 

The  TOUR  shall  detect  hazardous  weather  phenoaena  between  .25  and  48  T 
nai  in  ranga. 

3192 

C 

5.1.3 

3.2.1.2.5.2.1 

3 

NC 

Tha  TOUR  shall  datact  hazardous  weather  phenoaena  froa  0  to  24,000 
feat  AGL. 

T 

3210 

C 

5.1.3 

3.2.1.2.S.2.2.A 

3 

NC 

Tha  TDUR  shall  have  an  aziwth  rasolution  of  1  degree. 

T 

3211 

C 

5.1.3 

3.2.1.2.5.2.2.S 

3 

■NC 

Tha  TOUR  shall  have  the  following  ranga  rasolution:  150  aaters. 

T 

3212 

C 

5.1.3 

3.2.1.2.5.2.2.C 

3 

NC 

The  TDUR  shall  have  tha  following  elevation  resolution;  0.5  degree 
for  elevations  less  than  or  equal  to  3.0  degrees;  1  degree  for 
elevations  above  3.0  degrees. 

T 

3220 

C 

5.1.3 

3.2.1.2.5.2.3.A 

3 

NC 

The  TDUR  aziauth  error  accuracy  shall  not  excaad  .05  degree  over  the  T 
entire  detection  envelope. 

3221 

C 

5.1.3 

3.2.1.2.S.2.3.B 

3 

NC 

Tha  TDUR  range  error  accuracy  shall  not  exceed  50  aaters. 

T 

3222 

c 

5.1.3 

3.2.1.2.S.2.3.C 

3 

NC 

The  TDUR  elevation  error  accuracy  shall  not  exceed  .05  degree. 

T 

3230 

c 

5.1.3 

3.2.1.2.S.2.4 

3 

NC 

The  TOUR  shall  be  capable  of  detecting  a  -10.0  dBz  range  bin  and 
baaa  filling  target  with  a  signal-to-nolsa  ratio  of  6  d8  at  a  range 
of  16  nai. 

T 

3240 

c 

5.1.3 

3.2.1.2.S.2.S 

3 

NC 

The  TDUR  shall  be  capable  of  operating  within  the  frequency  band  of 
5.6  6Hz  to  S.6S  6Hz. 

T 

32S0 

c 

5.1.3 

3.2.1.2.S.2.6 

3 

NC 

The  TDUR  Shall  be  capable  of  providing  weather  data  continuously 

T 

uhU*  optratlng  undtr  tha  Telloulng  seaming  strateglaa:  360  dagraas 
azlwth  scans;  aziauth  sactor  scans;  ranga  halght  indicator  scan. 
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REQT 

RELTO 

REQTS 

VERF 

10 

CAT 

PAM 

HAS-$S-1000 

VOL 

C/NC 

DESCRIPTION 

NTO 

3260 

C  ^ 

5.1.3 

3.2.1.2.5.2.7 

3 

NC 

Tho  TDWR  shall  bo  capoblo  of  archiving  1  hour  of  derived  products. 

T 

3270 

c 

5.1.3 

3.2.1.2.S.2.8 

3 

NC 

The  TOW  shall  ganerata  a  olcrotaurst,  gust  front,  or  wind  shift 
alara  within  IS  saconds  froa  detection  of  the  alara  condition. 

T 

3280 

c 

5.1.3 

3.2.1.2.5.2.9 

3 

NC 

Tho  TOM  shall  provide  weather  data  to  specialists  that  is  no  older 
than  1  alnute. 

T 

3290 

c 

5.1.3 

3.2.1.2.5.2.10 

3 

NC 

The  TDWR  shall  disseainate  data  to  the  TCCC. 

D 

3291 

c 

5.1.3 

3.2.1.2.5.2.10 

3 

NC 

The  TOUR  shall  disseainate  data  to  the  NPS/RHSC. 

0 

3310 

c 

5.1.3 

3.2.1.2.5.2.12 

3 

NC 

Ueathor  data  shall  be  categorized  into  6  Levels  of  intensity  as 

T 

follows: 

LMol  1:  18  >  <  dBz  <  30; 

Lovol  2:  30  •  <  dBz  <  41; 

Lovol  3:  41  •  <  dBz  <  46; 

Lovol  4:  46  >  <  dBz  <  SO; 

Lovol  S:  SO  «  <  dBz  <  S7; 

Lovol  6:  dBz  ■  >  S7. 

No  data  display  shall  bo  oado  for  dBz  valuos  loss  than  18. 


APPENDIX  B 

TDWR  OT&E  INTEGRATION  HUMAN  FACTORS  EVALUATION  QUESTIONNAIRE 


CONTROLLERS.  SUPERVISORS.  AND  PARTICIPANTS. 

The  FAA  Technical  Center  is  supporting  the  test  of  the  TOUR  concept  at  Memphis 
International  Airport  (MEM) .  One  of  our  support  roles  is  the  collection  and 
analysis  of  user  evaluation  from  you,  the  MEM  controller/user  of  the  system. 

We  are  collecting  user  data  by  means  of  questionnaires.  We  want  to  get  your 
evaluation  of  the  TDWR  after  it  is  integrated  into  your  display  system. 

The  questionnaire  consists  of  12  questions  and  is  12  pages  long.  You  will  be  asked 
to  complete  the  form  just  prior  to  the  end  of  the  TDWR  demonstration,  on  or  about 
November  1,  1992. 

We  realize  that  you  are  busy;  therefore,  we  have  designed  the  questionnaire  to 
minimize  the  time  and  effort  needed  to  complete  it.  Your  inputs  as  users  of  TDWR 
and  its  display/control  Interface  are  very  important  in  this  effort  to  improve 
airport  weather  hazard  detection  and  the  display  interface. 

Please  read  over  the  questions  carefully.  If  any  of  them  are  unclear,  ask  the  FAA 
Technical  Center  representative  for  clarification. 

The  reason  for  briefing  you  on  this  test  and  evaluation  effort  is  to  alert  you  for 
things  to  look  for  and  to  think  about  when  you  use  the  TDWR.  This  should  be 
helpful  to  you  when  you  have  to  complete  the  questionnaire. 
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Questionnaire 


TDWR  EVALUATION 


Operator  Initials  _  Form  Completion  Date  _ . 

POSITION  (circle  those  which  are  applicable) 

TRACON  ---  TOWER  ---  SUPERVISOR  ---STAFF 

QUESTIONNAIRE  FOR  CONTROLLERS  AT  MEMPHIS  INTERNATIONAL  AIRIPORT 
HUMAN  FACTORS  EVALUATION  OF  TDWR 

Please  complete  this  form  and  return  to  the  representative  of  the  FAA  Technical 
Center.  If  you  place  your  operating  Initials  and  the  date  of  completion  at  the  top 
of  this  page,  It  may  help  us  to  resolve  your  suggestions  and  discussions.  Your 
answers  will  be  held  In  strict  confidence. 

1.  Please  rate  different  aspects  of  the  TDWR  using  the  following  scale:  (Place 
check  marks  In  appropriate  columns.) 

+3  “  Very  Good 
+2  Good 
+1  —  Fairly  Good 
0  -  Fair 
-1  -  Fairly  Poor 
-2  -  Poor 
-3  -  Very  Poor 
7  -  Don't  Know 


If  you  did  not  observe  a  particular  function,  you  need  not  answer  that  question  or 
portion  of  the  question. 

For  example.  If  you  did  not  use  the  Supervisor's  Graphical  Situation  Display,  you 
do  not  need  to  answer  the  GSD  questions. 


ASPECT  OF  TDWR 


a.  Daytime  readability  of 
the  display 

(1)  GSD 

(2)  RDT 

b.  Nighttime  readability 
of  the  display 

(1)  GSD 

(2)  RDT 

c.  Readability  of  display 
in  glare 

(1)  GSD 

(2)  RDT 

d.  Adequacy  of 
display  size 

(1)  GSD 

(2)  RDT 

e.  Audibility  of  the 
alarm  beeper 

(1)  GSD 

(2)  RDT 

f.  Placement  of  the  display 

(1)  GSD 

(2)  RDT 


RATING  SCALE 


-3 

-2 

■ 

1 

+1 

+2 

+3 

■ 

■ 

_ 
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RATING  SCALE 


ASPECT  OF  TDWR 

-3 

-2 

■ 

1 

+1 

+2 

+3 

■ 

1 

g.  Completeness  of  the 
displayed  Information 

(1)  GSD 

(2)  RDT 

h.  Accuracy  of  the 
displayed  Information 

(1)  GSD 

(2)  RDT 

I.  Rate  of  false  alarms 

(many-- 3  ;  few-H-3) 

(1)  GSD 

(2)  RDT 

J .  Timeliness  of  the 
displayed  Information 

(1)  GSD 

(2)  RDT 

k.  Usefulness  of  the 
displayed  Information 

(1)  GSD 

(2)  RDT 

l .  Freedom  from 
misinterpretation 

(1)  GSD 

(2)  RDT 
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RATING  SCALE 


(2)  RDT 


ASPECT  OF  TDWR 


s.  How  useful  would  wind 
arrows  be  on  the  GSO? 

t.  Rate  usefulness  of  the 
Gust  Front  Presentation 

GSD 

u.  Rate  usefulness  of  the 
Wind  Shift  Prediction 

GSD 

V.  Rate  usefulness  of  the 
TDVR  training  received 

(1)  GSD 

(2)  RDT 

w.  Rate  usefulness  of  the 
TDVR  runway  management 

(1)  GSD 

(2)  RDT 
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RATING  SCALE 


Please  comment  on  the  TDUR  training  received; 


Operator  Initials 


Form  Completion  Date 


2.  Do  you  see  the  TDWR  as  a  help  or  hindrance  to  you  in  your  job  of  controlling 
local  traffic?  (Please  circle  one  letter  below.) 

a.  A  great  help  Any  comments?  _ 

b.  A  help 

c.  A  slight  help  _ 

d.  Neither  help  nor  hindrance 

e.  A  slight  hindrance  _ 

f .  A  hindrance 

g.  A  great  hindrance  _ 

h .  Don ' t  know 


3.  Do  you  see  the  TDWR  as  a  help  or  a  hindrance  to  the  pilot?  (Please 
circle  one  letter  below. } 

a.  A  great  help  Any  comments?  _ 

b .  A  help 

c.  A  slight  help  _ 

d.  Neither  help  nor  hindrance 

e.  A  slight  hindrance  _ _ 

f .  A  hindrance 

g.  A  great  hindrance  _ 

h.  Don't  know 


4.  Do  you  see  the  TDWR  as  a  help  or  a  hindrance  to  Planning  and  Traffic 
Management?  (Please  circle  one  letter  below.) 

a.  A  great  help  Any  comments?  _ 

b.  A  help 

c.  A  slight  help  _ 

d.  Neither  help  nor  hindrance 

e.  A  slight  hindrance  _ 

f .  A  hindrance 

g.  A  great  hindrance  _ 

h.  Don't  know 


5.  What's  good  about  the  TDWR?  What  benefits  do  you  see? 
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Operator  Initials 


Form  Completion  Date 


6.  What's  poor  about  the  TDWR?  What  problems  do  you  see? 


7.  Please  rate  the  relative  magnitude  of  benefits  and  problems  of  the  TDWR 
by  circling  the  appropriate  letter  below. 

a.  Benefits  greatly  exceed  problems.  Any  comments?  _ 

b.  Benefits  exceed  problems. 

c.  Benefits  slightly  exceed  problems.  _ 

d.  Benefits  eqtial  problem. 

e.  Problems  slightly  exceed  benefits.  _ 

f.  Problems  exceed  benefits. 

g.  Problems  greatly  exceed  benefits.  _ 

h.  Don't  know. 


8.  Compare  the  overall  effectiveness  of  the  TDWR  to  the  LLWAS.  Choose  a 

phrase  below  to  fill  the  blank.  "The  TDWR  is  _  the 

LLWAS." 

a.  much  better  than  Any  comments?  _ 

b.  better  than 

c.  slightly  better  than  _ 

d.  about  the  same  as 

e.  slightly  worse  than  _ 

f.  worse  than 

g.  much  worse  than  _ 

h .  Don ' t  know 
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9.  Based  on  your  present  knowledge,  please  rate  the  TDWR's  suitability  for 
widespread  operational  use  in  the  field.  Please  circle  one  of  the  letters  a. 
through  h. 

a.  Suitable,  fine  as  is,  don't  make  any  changes. 

b.  Suitable,  minor  adjustments  optional. 

c.  Suitable,  but  some  changes  beneficial. 

d.  Marginally  suitable,  but  make  changes. 

e.  Unsuitable,  changes  definitely  needed  prior  to  installation. 

f.  Unsuitable,  concept  OK,  but  extensive  rework  mandatory. 

g.  Unsuitable,  entire  concept  inappropriate. 

h.  Don't  know. 


10.  Based  on  your  present  knowledge,  please  rate  the  TDWR  usefulness  to  the  pilot. 

_  Very  Good 

_  Good 

_  Fairly  Good 

_  Fair 

_  Fairly  Poor 

_  Poor 

_  Very  Poor 

_  Don't  Know 


Please  list  here  any  changes  you  feel  should  be  made  to  the  TDUR. 
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11.  For  future  planning,  please  Indicate  (by  check  marks)  on  the  chart  below  which 
of  the  TDWR  DISPLAY  DATA  PRODUCTS  you  would  desire  to  have  available  for  selection 
and  which  DISPLAY  you  would  desire  to  see  tham  on.  Assume  that  you  would  have  a 
"Push  Button"  to  select  or  deselect  the  weather  products  as  desired. 


No 

extra 

data 

TDWR  DI£ 

Precip¬ 

itation 

5PLAY  PI 

Gust- 

front 

(ODUCTS 

Micro - 
burst 

Wind 

Arrows 

TRACON  Control  Position 
Display  (DEDS,  etc.) 

TOWER  Control  Position 
Display  (BRITE,  etc.) 

TOWER  Control  Position 
GSD  Type  Display  Used 

In  Place  of  "BRITE", 
with  ARTS  Data  as  on 
BRITE  Display  now 

"Cockpit"  mini  GSD 

Any  additional  comments  or  suggestions : 
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If  you  did  not  observe  Wind  Shear  Prediction  Products,  then  proceed  to  page  15. 

12.  THE  WIND  SHEAR  PREDICTION  PRODUCTS  QUESTIONS 
A.  If  you  did  observe  Wind  Shear  Predictions: 

How  well  did  it  work?  _  _ 


Did  it  successfully  predict  wind  shear?  (Give  examples) 


Did  it  give  false  alarm?  (Give  examples) 
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B.  Was  the  product  useful  and  did  it  aid  in  making  runway  configuration 
changes?  (Give  specific  times.) 


C.  Did  you  use  the  product  to  alert  controllers  that  windshears  might 

be  imminent?  (Y/N)  _ . 

D.  Was  the  display  format  acceptable?  Would  you  change  anything? 


E.  What  comments  do  you  have  on  the  product?  How  could  it  be  improved? 
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As  an  experienced  Air  Traffic  Control  Specialist  and  user  of  this  equipment,  your 
input  is  valuable  to  us  in  our  efforts  to  improve  it  and  to  increase  the  efficiency 
and  safety  of  the  National  Airspace  System. 

Thank  you  for  your  cooperation. 


PATRICK  MARTIN.  TEST  DIRECTOR 


